-- Logs begin at Wed 2022-07-13 19:58:21 UTC, end at Wed 2022-07-13 21:29:56 UTC. -- Jul 13 20:56:02.013689 dv-cinder-799871-27-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 13 20:56:02.021864 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 13 20:56:02.023904 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 13 20:56:02 2022] *** Jul 13 20:56:02.023904 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 13 20:56:02.023904 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 13 20:56:02.023904 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: nodename: dv-cinder-799871-27-iscsi Jul 13 20:56:02.023904 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: machine: x86_64 Jul 13 20:56:02.023904 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: clock source: unix Jul 13 20:56:02.023904 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: pcre jit disabled Jul 13 20:56:02.023904 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: detected number of CPU cores: 4 Jul 13 20:56:02.023904 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: current working directory: / Jul 13 20:56:02.023904 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: detected binary path: /usr/bin/uwsgi-core Jul 13 20:56:02.024566 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: your processes number limit is 47680 Jul 13 20:56:02.024566 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: your memory page size is 4096 bytes Jul 13 20:56:02.024566 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: detected max file descriptor number: 2048 Jul 13 20:56:02.024566 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: lock engine: pthread robust mutexes Jul 13 20:56:02.024566 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: thunder lock: enabled Jul 13 20:56:02.024566 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 13 20:56:02.024566 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 13 20:56:02.068289 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: Python main interpreter initialized at 0x55b02a3779c0 Jul 13 20:56:02.068289 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: python threads support enabled Jul 13 20:56:02.068289 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: your server socket listen backlog is limited to 100 connections Jul 13 20:56:02.068289 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: your mercy for graceful operations on workers is 90 seconds Jul 13 20:56:02.068605 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: mapped 403077 bytes (393 KB) for 2 cores Jul 13 20:56:02.068677 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: *** Operational MODE: preforking *** Jul 13 20:56:02.068941 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: *** uWSGI is running in multiple interpreter mode *** Jul 13 20:56:02.068941 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: spawned uWSGI master process (pid: 103948) Jul 13 20:56:02.069119 dv-cinder-799871-27-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 13 20:56:02.070068 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: spawned uWSGI worker 1 (pid: 103949, cores: 1) Jul 13 20:56:02.070663 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: spawned uWSGI worker 2 (pid: 103950, cores: 1) Jul 13 20:56:02.070860 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 13 20:56:02.725609 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 13 20:56:02.726208 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 13 20:56:03.844306 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 20:56:03.844306 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: from cryptography.utils import int_from_bytes Jul 13 20:56:03.844907 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 20:56:03.844907 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: from cryptography.utils import int_from_bytes Jul 13 20:56:03.844907 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 20:56:03.844907 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: from cryptography.utils import int_from_bytes Jul 13 20:56:03.845378 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 20:56:03.845378 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: from cryptography.utils import int_from_bytes Jul 13 20:56:06.308497 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 13 20:56:06.309042 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 13 20:56:06.309397 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 13 20:56:06.309486 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 13 20:56:06.309586 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 13 20:56:06.309677 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 13 20:56:06.309772 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 13 20:56:06.309862 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 13 20:56:06.309953 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 13 20:56:06.310033 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 13 20:56:06.310231 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.310328 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.310557 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.310686 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.310911 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.311008 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.311227 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.311315 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.311554 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.311641 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.311868 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.311965 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.312187 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.312280 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.312503 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.312595 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.312828 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.312922 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.313087 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.313180 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.313401 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.313485 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.313723 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-27-iscsi {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.313815 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-27-iscsi {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.314044 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.314143 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.314350 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.314488 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.314680 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.314771 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.315000 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.315087 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.315305 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.315393 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.315626 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.315711 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.315928 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.316018 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.316423 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.316539 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.317572 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.317709 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.317825 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.317921 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.318085 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.318169 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.318295 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.318393 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.318474 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.318559 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.318672 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.318756 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.318833 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.318958 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.319048 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.319135 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.319285 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.319423 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.319595 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.319695 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.319990 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-27-iscsi {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.320080 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-27-iscsi {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.320306 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.320398 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.320618 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.320704 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.320968 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.321076 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.321330 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.321433 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.321640 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.321733 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.322468 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.322567 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.322817 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.322916 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.323143 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.323236 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.323451 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.323546 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.323777 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.323863 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.324093 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.324178 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.324413 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.324508 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.324732 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.324825 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.325034 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.325125 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.325340 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.325425 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.325646 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.325731 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.325960 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.326044 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.326262 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.326358 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.326563 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.326670 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.326845 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.326975 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.327150 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.327247 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.327469 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.327572 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.327785 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.327879 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.328105 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.328200 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.328364 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.328457 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.328601 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.328704 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.328917 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.329017 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.329234 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.329326 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.329539 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.329632 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.329846 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.329954 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.330149 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.330247 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.330452 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.330536 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.330783 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.330869 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.331089 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.331181 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.331394 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.331478 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.331698 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.331788 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.332016 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.332110 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.332332 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.332414 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.332650 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.332732 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.332955 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.333048 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.333273 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.333363 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.333662 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.333744 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.333912 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.334002 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.334217 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.334306 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.334553 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.334667 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.334898 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.334997 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.335204 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.335287 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.335523 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.335619 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.335841 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.335926 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.336149 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.336240 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.336452 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.336534 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.336756 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.336841 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.337073 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.337157 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.337395 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.337510 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.338282 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.338428 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.338522 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.338608 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.338849 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.338936 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.339154 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.339239 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.339471 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.339568 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.339776 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.339873 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.340082 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.340166 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.340387 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.340469 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.340685 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.340777 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.340989 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.341071 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.341292 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.341382 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.341598 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.341690 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.341902 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.341986 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.342208 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.342290 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.342514 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.342606 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.342849 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.342933 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.343155 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.343237 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.343459 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.343560 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.343776 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.343866 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.344097 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.344187 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.344405 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.344498 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.344711 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.344793 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.345016 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.345107 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.345324 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.345427 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.345645 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.345740 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.345946 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.346038 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.346252 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.346344 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.346573 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.346702 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.346907 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.346990 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.347212 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.347308 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.347530 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.347613 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.347836 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.347927 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.348141 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.348225 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.348459 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.348550 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.348761 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.348854 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.349067 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.349151 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.349385 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.349477 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.349691 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.349781 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.349993 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.350083 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.350298 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.350390 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.350599 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.350706 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.350926 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.351010 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.351230 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.351319 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.351533 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.351626 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.351836 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.351919 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.352135 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.352224 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.352455 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.352546 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.352774 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.352864 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.353103 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.353186 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.353416 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.353552 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.353718 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.353801 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.354035 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.354118 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:56:06.354366 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.354461 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.354724 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.354822 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.355070 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.355155 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.355386 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.355470 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.355722 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.355841 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.356053 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.356162 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.356370 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.356467 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.356683 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.356779 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.356996 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.357092 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.357322 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.357426 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.357632 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.357727 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.357942 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.358047 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.358252 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.358346 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.358571 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.358697 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.358914 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.359040 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.359242 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.359351 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.359563 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.359659 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.359879 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.359985 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.360205 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.360298 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.360507 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.360603 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.360821 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.360917 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.361148 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.361234 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.361470 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.361614 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.361778 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.361873 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.362119 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.362249 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.362465 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.362594 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.362805 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.362945 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.363133 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.363282 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.363455 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.363540 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.363766 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.363851 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.364077 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.364160 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.364385 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.364468 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.364705 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.364790 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.365036 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.365120 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.365349 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.365431 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.365668 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.365772 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.365980 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.366075 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.366293 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.366377 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.366601 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.366717 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.366938 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.367021 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.367250 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.367355 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.367588 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.367691 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.367903 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.367997 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.368218 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.368320 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.368531 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.368616 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.368876 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.368959 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.369187 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.369278 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.369502 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.369587 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.369813 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.369903 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.370115 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.370207 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.370421 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.370570 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.370748 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.370874 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.371059 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.371179 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.371364 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.371459 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.371683 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.371763 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.372006 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.372108 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.372310 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.372403 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.372642 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.372727 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.372947 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.373031 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.373256 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.373339 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.373564 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.373674 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.373873 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.373960 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.374178 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.374252 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.374487 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.374570 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.374820 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.374906 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.375126 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.375209 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.375450 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.375542 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.375761 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.375857 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.376065 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.376139 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.376389 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.376495 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.376691 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.376766 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.376997 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.377092 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.377314 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.377405 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.377628 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.377746 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.377939 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.378040 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.378251 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.378359 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.378871 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.379360 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.379445 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.379539 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.379631 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.379713 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.379793 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.379872 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.379951 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.380030 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.380117 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.380198 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.380429 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.380532 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.380755 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.380860 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.381077 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.381167 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.381391 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.381476 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.381695 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.381794 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.382008 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.382106 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.382311 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.382399 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.382636 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.382739 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.382942 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.383027 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.383250 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.383336 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.383553 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.383651 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.383857 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.383946 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.384159 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.384244 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.384990 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.385092 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.385294 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.385388 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.385615 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.385700 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.385922 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.386017 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.386228 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.386314 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.386532 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.386661 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.386862 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.386951 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.387206 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.387294 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.387514 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.387601 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.387853 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.387948 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.388190 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.388278 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.388540 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.388644 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.388829 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.388917 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.389142 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.389227 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.389456 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.389541 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.389766 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.389853 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.390077 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.390162 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.390388 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.390483 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.390756 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.390905 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.391045 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.391182 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.391326 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.391477 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.391648 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.391786 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.391958 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.392196 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.392336 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.392480 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.392629 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.392765 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.392898 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.393037 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.393172 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.393313 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.393484 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.393624 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.393823 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.393966 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.394153 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.394298 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.394468 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.394603 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.394814 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.394947 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.395162 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.395298 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.395433 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.395566 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.395725 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.395872 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.396037 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.396184 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.396345 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.396489 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.396654 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.396794 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.396970 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.397106 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.397281 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.397425 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.397598 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.397733 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.397906 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.398049 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.398228 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.398360 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.398534 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.398714 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.398880 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.399017 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.399183 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.399320 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.399494 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.399639 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.399819 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.400546 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.400709 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.400854 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.400992 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.401136 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.401296 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.401439 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.401615 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.401751 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.401925 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.402070 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.402224 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.402352 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.402530 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.402711 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.402846 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.402991 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.403159 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.403292 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.403466 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.403601 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.403779 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.403915 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.404088 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.404228 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.404672 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.404820 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.404984 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.405119 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.405257 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.405392 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.405568 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.405701 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.405870 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.406015 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.406173 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.406318 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.406483 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.406681 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.406844 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.406980 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.407122 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.407257 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.407433 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.407578 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.407750 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.407886 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.408036 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.408168 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.408342 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.408487 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.408661 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.408807 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.408966 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.409099 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.409269 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.409416 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.409573 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.409709 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.409873 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.410010 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.410224 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.410367 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.410520 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.410674 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.410846 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.410978 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.411163 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.411300 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.411479 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.411615 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.411784 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.411921 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.412096 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.412232 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.412409 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.412523 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.412712 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.412797 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.413032 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.413124 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.413341 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.413425 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.413649 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.413732 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.413959 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.414050 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.414266 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.414349 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.414574 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.414694 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.414909 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.414993 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.415229 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.415314 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.415553 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.415651 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.415868 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.415959 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.416175 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.416258 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.416477 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.416568 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.416785 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.416869 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.417100 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.417197 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.417663 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.417758 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.418011 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.418100 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.418311 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.418403 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.418708 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.418798 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.418970 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.419054 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.419288 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.419374 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.419618 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.419709 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.419944 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.420028 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.420277 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.420368 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.420581 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.420747 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.420894 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.421055 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.421206 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.421359 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.421493 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.421589 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.421784 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.421873 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.422086 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.422172 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.422390 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.422529 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.422722 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.422813 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.423034 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.423133 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.423336 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.423422 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.423637 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.423725 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.423936 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.424023 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.424238 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.424327 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.424553 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.424639 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.424856 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.424949 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.425166 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.425261 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.425467 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.425568 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.425786 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.425872 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.426092 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.426192 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.426392 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.426479 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.426717 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.426807 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.427021 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.427119 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.427357 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.427445 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.427658 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.427752 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.427992 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.428087 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.428318 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.428417 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.428654 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.428748 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.428957 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.429044 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.429258 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.429350 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.429578 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.429670 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.429880 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.429975 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.430180 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.430273 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.430479 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.430564 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.430809 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.430897 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.431118 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.431212 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.431444 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.431577 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.431753 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.431840 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.432060 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.432154 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.432367 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.432463 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.432676 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.432813 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.432960 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.433093 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.433270 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.433420 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.433559 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.433698 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.433868 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.434005 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.434172 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.434316 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.434473 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.434609 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.434797 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.434943 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.435097 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.435248 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.435403 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.435540 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.435702 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.435839 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.436007 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.436143 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.436289 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.436421 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.436604 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.436749 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.436905 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.437038 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.437181 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.437314 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.437480 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.437623 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.437768 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.437901 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.438078 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.438214 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.438361 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.438450 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.438706 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.438842 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.439019 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.439151 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.439321 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.439467 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.439623 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.439760 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.439930 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.440079 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.440214 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.440354 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.440519 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.440666 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.440825 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.440961 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.441144 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.441298 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.441456 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.441588 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.441757 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.441888 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.442061 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.442206 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.442363 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.442498 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.442702 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.442838 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.442990 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.443125 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.443262 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.443396 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.443567 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.443703 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.443866 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.444011 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.444152 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.444286 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.444453 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.444601 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.444753 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.444888 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.445056 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.445193 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.445362 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.445500 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.445667 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.445810 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.445967 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.446104 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.446266 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.446410 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.446603 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.446757 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.447446 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.447593 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.447808 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.447952 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.448114 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.448245 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.448425 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.448556 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.448740 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.448946 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.449102 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.449239 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.449382 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.449519 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.449655 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.449799 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.449938 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.450074 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.450238 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.450373 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.450545 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.450704 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.450886 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.451043 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.451188 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.451324 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.451476 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.451565 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.451794 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.451879 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.452101 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.452188 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.452408 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.452496 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.452725 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.452856 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.453046 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.453188 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.453384 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.453503 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.453665 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.453754 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.453970 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.454057 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.454277 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.454365 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.454581 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.454710 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.454913 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.455010 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.455219 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.455305 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.455527 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.455612 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.455834 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.455928 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.456144 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.456229 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.456451 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.456536 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.456761 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.456857 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.457063 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.457148 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.457370 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.457455 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.457674 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.457774 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.457976 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.458068 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.458294 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.458380 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.458604 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.458761 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.458920 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.459063 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.459223 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.459362 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.459528 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.459672 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.459835 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.459977 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.460119 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.460254 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.460547 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.460696 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.460856 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.461035 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.461187 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.461339 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.461474 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.461609 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.461752 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.461884 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.462049 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.462145 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.462359 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.463065 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.463238 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.463373 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.463545 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.463642 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.463961 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.464050 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.464269 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.464355 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.464578 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.464674 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.464886 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.464974 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.465191 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.465276 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.465492 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.465586 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.465801 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.465894 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.466122 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.466208 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.466422 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.466516 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.466746 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.466836 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.467049 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.467134 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.467368 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.467462 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.467669 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.467754 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.468002 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.468143 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.468393 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.468489 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.468701 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.468837 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.469000 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.469137 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.469408 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.469546 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.469718 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.469855 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.470025 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.470179 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.470344 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.470508 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.470692 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.470825 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.470998 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.471144 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.471301 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.471527 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.471673 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.471820 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.471968 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.472101 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.472239 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.472385 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.472520 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.472663 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.472797 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.472932 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.473114 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.473277 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.473413 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.473559 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.473725 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.473865 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.474043 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.474188 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.474355 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.474492 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.474695 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.474830 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.475111 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.475246 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.475431 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.475568 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.475739 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.475875 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.476060 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.476199 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.476382 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.476520 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.476685 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.476821 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.476970 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.477122 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.477283 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.477416 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.477587 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.477737 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.477879 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.478044 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.478228 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.478369 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.478535 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.478735 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.478869 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.479013 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.479172 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.479309 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.479480 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.479635 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.479772 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.479906 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.480074 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.480212 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.480396 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.480541 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.480697 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.480832 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.481019 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.481159 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.481332 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.481477 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.481645 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.481780 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.481958 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.482094 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.482263 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.482351 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.482583 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.482772 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.482915 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.483002 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.483222 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.483349 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.483527 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.483622 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.483832 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.483920 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.484175 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.484264 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.484479 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.484566 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.484798 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.484893 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.485125 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.485219 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.485450 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.485536 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.485757 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.485851 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.486085 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.486179 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.486407 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.486493 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.486743 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.486846 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.487060 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.487146 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.487382 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.487481 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.487683 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.487778 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.487986 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.488081 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.488292 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.488377 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.488594 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.488732 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.488897 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.488994 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.489199 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.489293 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.489504 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.489591 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.489804 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.489897 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.490109 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.490196 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.490410 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.490496 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.490752 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.490852 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.491059 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.491146 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.491379 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.491466 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.491684 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.491770 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.491985 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.492079 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.492287 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.492372 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.492587 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.492671 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.492925 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.493019 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.493230 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.493317 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.493562 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.494226 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.494396 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.494483 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.494728 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.494868 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.495061 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.495206 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.495372 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.495519 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.495694 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.495833 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.496013 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.496168 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.496334 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.496480 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.496652 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.496790 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.496968 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.497106 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.497287 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.497427 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.497604 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.497743 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.497919 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.498058 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.498209 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.498351 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.498523 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.498680 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.498862 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.499005 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.499185 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.499330 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.499694 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.499831 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.500023 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.500158 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.500335 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.500487 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.500632 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.500776 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.500944 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.501094 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.501259 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.501394 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.501571 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.501709 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.501881 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.501981 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.502189 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.502284 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.502496 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.502582 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.502831 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.502934 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.503158 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.503253 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.503478 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.503609 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.503805 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.503895 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.504138 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.504224 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.504452 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.504546 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.504768 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.504856 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.505080 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.505173 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.505394 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.505491 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.505749 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.505839 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.506064 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.506150 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.506368 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.506464 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.506717 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.506810 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.507038 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.507126 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.507352 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.507454 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.507662 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.507747 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.507973 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.508061 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.508286 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.508381 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.508597 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.508691 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.508905 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.509030 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.509213 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.509344 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.510099 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.510202 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.510416 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.510547 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.510768 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.510911 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.511106 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.511255 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.511424 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.511582 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.511743 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.511909 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.512062 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.512229 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.512386 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.512550 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.512902 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.513071 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.513219 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.513388 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.513569 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.513725 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.513889 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.514053 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.514216 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.514381 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.514534 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.514722 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.514882 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.515045 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.515212 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.515373 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.515521 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.515683 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.515825 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.515991 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.516136 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.516304 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.516447 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.516616 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.516751 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.516923 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.517071 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.517246 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.517381 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.517558 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.517687 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.517865 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.518004 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.518184 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.518315 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.518493 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.518866 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.519057 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.519219 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.519438 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.519576 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.519723 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.519861 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.520031 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.520169 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.520361 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.520509 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.520686 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.520823 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.520998 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.521154 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.521325 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.521469 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.521631 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.521767 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.521935 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.522084 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.522230 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.522383 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.522524 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.522610 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.522847 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.522950 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.523160 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.523255 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.523471 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.523559 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.523783 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.523891 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.524089 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.524182 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.524393 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.524480 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.524696 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.524785 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.525041 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.525139 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.525348 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.525436 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.525699 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.525793 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.525960 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.526048 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.526261 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.526356 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.526566 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.526704 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.526896 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.526982 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.527201 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.527299 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.527504 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.527599 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.527806 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.527902 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.528112 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.528248 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.528415 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.528502 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.528717 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.528803 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.529017 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.529112 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.529586 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.529682 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.529906 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.530001 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.530250 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.530350 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.530558 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.530666 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.530890 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.530979 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.531196 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.531293 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.531502 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.531600 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.531809 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.531905 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.532124 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.532221 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.532435 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.532560 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.532749 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.532836 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.533081 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.533170 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.533400 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.533615 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.533931 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.534031 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.534264 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.534361 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.534589 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.534707 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.534945 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.535044 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.535253 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.535342 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.535563 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.535650 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.535869 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.535969 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.536176 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.536264 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.536488 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.536574 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.536800 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.536898 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.537108 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.537195 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.537415 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.537501 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.537720 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.537816 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.538027 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.538113 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.538335 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.538430 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.538661 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.538753 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.538975 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.539062 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.539283 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.539380 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.539591 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.539686 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.539896 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.539989 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.540201 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.540287 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.540510 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.540620 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.540849 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.540938 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.541191 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.541288 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.541505 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.541593 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.541821 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.541906 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.542133 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.542230 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.542444 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.542534 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.542780 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.542889 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.543091 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.543187 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.543397 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.543485 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.543703 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.543796 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.544019 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.544122 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.544331 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.544418 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.544639 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.544726 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.544941 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.545054 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.545359 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.545446 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.545674 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.545760 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.545991 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.546088 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.546299 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.546385 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.546610 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.546773 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.546955 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.547045 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.547264 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.547357 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.547577 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.547673 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.547886 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.547980 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.548195 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.548282 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.548526 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.548693 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.548852 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.548939 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.549176 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.549263 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.549483 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.549579 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.549789 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.549885 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.550092 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.550190 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.550399 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.550496 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.550738 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.550829 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.551046 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.551132 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.551349 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.551438 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.551650 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.551746 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.551955 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.552041 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.552258 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.552354 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.552559 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.552645 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.552857 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.552954 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.553159 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.553246 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.553461 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.553558 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.553763 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.553862 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.554063 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.554157 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.554362 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.554449 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.554683 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.554785 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.554989 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.555076 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.555290 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.555383 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.555596 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.555695 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.555900 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.555989 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.556711 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.556808 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.557014 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.557114 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.557315 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.557402 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.557614 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.557700 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.557913 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.558007 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.558243 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.558339 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.558566 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.558698 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.558909 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.559005 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.559220 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.559307 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.559534 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.559627 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.559841 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.559936 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.560154 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.560241 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.560473 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.560567 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.560791 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.560880 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.561101 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.561198 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.561408 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.561504 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.561731 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.561818 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.562038 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.562126 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.562349 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.562452 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.562678 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.562770 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.562992 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.563088 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.563301 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.563445 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.563613 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.563708 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.563938 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.564033 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.564251 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.564349 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.564554 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.564648 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.564880 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.564974 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.565198 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.565287 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.565516 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.565604 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.565829 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.565916 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.566145 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.566232 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.566455 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.566541 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.566794 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.566898 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.567112 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.567224 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.567413 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.567499 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.567722 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.567818 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.568034 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.568163 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.568345 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.568433 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.568654 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.568750 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.568968 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.569056 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.569279 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.569365 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.569592 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.569679 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.569920 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.570013 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.570229 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.570316 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.570545 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.570689 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.570898 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.570997 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.571225 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.571319 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.571539 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.571635 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.572418 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.572510 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.572749 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.572870 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.573079 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.573172 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.573391 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.573475 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.573699 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.573799 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.573947 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 13 20:56:06.574034 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:56:06.574237 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 13 20:56:06.636083 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO dbcounter [None req-15841389-988f-40e3-909d-2352d9573313 None None] Registered counter for database nova_api Jul 13 20:56:06.636240 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO dbcounter [None req-30af2795-06d1-4e90-ad93-c38c9dc9f635 None None] Registered counter for database nova_api Jul 13 20:56:06.747402 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG oslo_db.sqlalchemy.engines [None req-15841389-988f-40e3-909d-2352d9573313 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 20:56:06.750358 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG oslo_db.sqlalchemy.engines [None req-30af2795-06d1-4e90-ad93-c38c9dc9f635 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 20:56:06.753898 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writer thread running {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 20:56:06.756741 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG dbcounter [-] [103949] Writer thread running {{(pid=103949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 20:56:06.810137 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.context [None req-15841389-988f-40e3-909d-2352d9573313 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7dc43128-f6a8-43a1-9bd0-df8b45860749(cell1) {{(pid=103950) load_cells /opt/stack/nova/nova/context.py:464}} Jul 13 20:56:06.813190 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.context [None req-30af2795-06d1-4e90-ad93-c38c9dc9f635 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7dc43128-f6a8-43a1-9bd0-df8b45860749(cell1) {{(pid=103949) load_cells /opt/stack/nova/nova/context.py:464}} Jul 13 20:56:06.814014 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-15841389-988f-40e3-909d-2352d9573313 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 20:56:06.815621 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-15841389-988f-40e3-909d-2352d9573313 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 20:56:06.816416 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-15841389-988f-40e3-909d-2352d9573313 None None] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 20:56:06.817089 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG oslo_concurrency.lockutils [None req-30af2795-06d1-4e90-ad93-c38c9dc9f635 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 20:56:06.818529 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-15841389-988f-40e3-909d-2352d9573313 None None] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 20:56:06.818645 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG oslo_concurrency.lockutils [None req-30af2795-06d1-4e90-ad93-c38c9dc9f635 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 20:56:06.819440 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG oslo_concurrency.lockutils [None req-30af2795-06d1-4e90-ad93-c38c9dc9f635 None None] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 20:56:06.820532 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO dbcounter [None req-15841389-988f-40e3-909d-2352d9573313 None None] Registered counter for database nova_cell0 Jul 13 20:56:06.821551 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG oslo_concurrency.lockutils [None req-30af2795-06d1-4e90-ad93-c38c9dc9f635 None None] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 20:56:06.824158 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO dbcounter [None req-30af2795-06d1-4e90-ad93-c38c9dc9f635 None None] Registered counter for database nova_cell0 Jul 13 20:56:06.824904 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO dbcounter [None req-15841389-988f-40e3-909d-2352d9573313 None None] Registered counter for database nova_cell1 Jul 13 20:56:06.828088 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO dbcounter [None req-30af2795-06d1-4e90-ad93-c38c9dc9f635 None None] Registered counter for database nova_cell1 Jul 13 20:56:06.833183 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG oslo_db.sqlalchemy.engines [None req-15841389-988f-40e3-909d-2352d9573313 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 20:56:06.834339 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG oslo_db.sqlalchemy.engines [None req-15841389-988f-40e3-909d-2352d9573313 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 20:56:06.836115 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG oslo_db.sqlalchemy.engines [None req-30af2795-06d1-4e90-ad93-c38c9dc9f635 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 20:56:06.840110 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG oslo_db.sqlalchemy.engines [None req-30af2795-06d1-4e90-ad93-c38c9dc9f635 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 20:56:06.841163 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writer thread running {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 20:56:06.842446 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writer thread running {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 20:56:06.842595 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG dbcounter [-] [103949] Writer thread running {{(pid=103949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 20:56:06.983137 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG dbcounter [-] [103949] Writer thread running {{(pid=103949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 20:56:06.988592 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO dbcounter [None req-15841389-988f-40e3-909d-2352d9573313 None None] Registered counter for database nova_cell0 Jul 13 20:56:06.992290 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO dbcounter [None req-30af2795-06d1-4e90-ad93-c38c9dc9f635 None None] Registered counter for database nova_cell0 Jul 13 20:56:06.998003 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG oslo_db.sqlalchemy.engines [None req-15841389-988f-40e3-909d-2352d9573313 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 20:56:07.001484 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG oslo_db.sqlalchemy.engines [None req-30af2795-06d1-4e90-ad93-c38c9dc9f635 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 20:56:07.002436 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writer thread running {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 20:56:07.005841 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG dbcounter [-] [103949] Writer thread running {{(pid=103949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 20:56:07.338885 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: WARNING keystonemiddleware.auth_token [None req-30af2795-06d1-4e90-ad93-c38c9dc9f635 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 13 20:56:07.339437 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: WARNING keystonemiddleware.auth_token [None req-15841389-988f-40e3-909d-2352d9573313 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 13 20:56:07.346106 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: WARNING keystonemiddleware.auth_token [None req-30af2795-06d1-4e90-ad93-c38c9dc9f635 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 13 20:56:07.346439 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: WARNING keystonemiddleware.auth_token [None req-15841389-988f-40e3-909d-2352d9573313 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 13 20:56:07.685158 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: WARNING keystonemiddleware.auth_token [None req-30af2795-06d1-4e90-ad93-c38c9dc9f635 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 13 20:56:07.687504 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: WARNING keystonemiddleware.auth_token [None req-15841389-988f-40e3-909d-2352d9573313 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 13 20:56:07.691115 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: WARNING keystonemiddleware.auth_token [None req-30af2795-06d1-4e90-ad93-c38c9dc9f635 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 13 20:56:07.693403 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: WARNING keystonemiddleware.auth_token [None req-15841389-988f-40e3-909d-2352d9573313 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 13 20:56:07.696324 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b02a3779c0 pid: 103949 (default app) Jul 13 20:56:07.698928 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-30af2795-06d1-4e90-ad93-c38c9dc9f635 None None] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:56:07.699149 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b02a3779c0 pid: 103950 (default app) Jul 13 20:56:07.700103 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-30af2795-06d1-4e90-ad93-c38c9dc9f635 None None] 10.222.0.39 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001775 Jul 13 20:56:07.700507 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 788 bytes} [Wed Jul 13 20:56:07 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 20:57:22.468122 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-15841389-988f-40e3-909d-2352d9573313 None None] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:57:22.469340 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-15841389-988f-40e3-909d-2352d9573313 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001969 Jul 13 20:57:22.469893 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 930 bytes} [Wed Jul 13 20:57:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 20:57:22.481354 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG dbcounter [-] [103949] Writing DB stats nova_api:SELECT=3 {{(pid=103949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:57:22.482212 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG dbcounter [-] [103949] Writing DB stats nova_cell0:SELECT=3 {{(pid=103949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:57:22.482941 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG dbcounter [-] [103949] Writing DB stats nova_cell1:SELECT=3 {{(pid=103949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:57:22.484116 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG dbcounter [-] [103949] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:57:23.309847 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-c90c2a10-4215-4bd6-9db3-ab5bef14724f admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:57:23.341704 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-c90c2a10-4215-4bd6-9db3-ab5bef14724f admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.866222 Jul 13 20:57:23.342427 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 2/3] 10.222.0.39 () {60 vars in 1291 bytes} [Wed Jul 13 20:57:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 20:57:25.563492 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-15841389-988f-40e3-909d-2352d9573313 None None] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:57:25.564557 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-15841389-988f-40e3-909d-2352d9573313 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jul 13 20:57:25.564959 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 2/4] 10.222.0.39 () {54 vars in 930 bytes} [Wed Jul 13 20:57:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 20:57:26.030314 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-6d91b15d-8809-446a-a03b-8dbd62494fc6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "id": "c1", "name": "cirros256", "ram": 256}} {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 20:57:26.049273 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 20:57:26.049273 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: warnings.warn(msg) Jul 13 20:57:26.076629 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-6d91b15d-8809-446a-a03b-8dbd62494fc6 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.504790 Jul 13 20:57:26.081604 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 3/5] 10.222.0.39 () {64 vars in 1282 bytes} [Wed Jul 13 20:57:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 20:57:26.311082 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-06261d0b-2bc0-423b-a8ae-8a884822f68f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 20:57:26.313508 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 20:57:26.313508 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: warnings.warn(msg) Jul 13 20:57:26.316415 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_api:SELECT=3 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:57:26.317500 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_cell1:SELECT=3 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:57:26.318395 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_cell0:SELECT=3 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:57:26.319177 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:57:26.381173 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-06261d0b-2bc0-423b-a8ae-8a884822f68f admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.295357 Jul 13 20:57:26.381832 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 3/6] 10.222.0.39 () {64 vars in 1335 bytes} [Wed Jul 13 20:57:26 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 20:57:28.604599 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-6d91b15d-8809-446a-a03b-8dbd62494fc6 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:57:28.606539 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-6d91b15d-8809-446a-a03b-8dbd62494fc6 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002564 Jul 13 20:57:28.607754 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 4/7] 10.222.0.39 () {54 vars in 930 bytes} [Wed Jul 13 20:57:28 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 20:57:29.269848 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-5c72621c-779e-426b-b953-b64c9c073835 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "id": "d1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "ram": 512, "name": "ds512M"}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 20:57:29.292049 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 20:57:29.292049 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: warnings.warn(msg) Jul 13 20:57:29.312532 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-5c72621c-779e-426b-b953-b64c9c073835 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.698863 Jul 13 20:57:29.313091 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 4/8] 10.222.0.39 () {64 vars in 1282 bytes} [Wed Jul 13 20:57:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 20:57:29.324783 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-549539f9-ab1d-4aa0-952a-afb2b7c5101d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 20:57:29.326287 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 20:57:29.326287 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: warnings.warn(msg) Jul 13 20:57:29.360279 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-549539f9-ab1d-4aa0-952a-afb2b7c5101d admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039019 Jul 13 20:57:29.360831 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 5/9] 10.222.0.39 () {64 vars in 1335 bytes} [Wed Jul 13 20:57:29 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 20:57:31.594133 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-5c72621c-779e-426b-b953-b64c9c073835 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:57:31.595773 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-5c72621c-779e-426b-b953-b64c9c073835 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001869 Jul 13 20:57:31.596398 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 930 bytes} [Wed Jul 13 20:57:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 20:57:32.032073 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-18c734ac-9dd9-43df-b976-2771b610b853 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d2", "name": "ds1G", "disk": 10}} {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 20:57:32.050840 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-18c734ac-9dd9-43df-b976-2771b610b853 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.448121 Jul 13 20:57:32.051435 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 6/11] 10.222.0.39 () {64 vars in 1282 bytes} [Wed Jul 13 20:57:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 20:57:32.063162 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-6557b656-b1f9-4d1e-858d-b26515f20fba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 20:57:32.086603 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-6557b656-b1f9-4d1e-858d-b26515f20fba admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027148 Jul 13 20:57:32.087194 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 6/12] 10.222.0.39 () {64 vars in 1335 bytes} [Wed Jul 13 20:57:32 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 20:57:34.291905 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-18c734ac-9dd9-43df-b976-2771b610b853 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:57:34.292926 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-18c734ac-9dd9-43df-b976-2771b610b853 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 13 20:57:34.293349 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 7/13] 10.222.0.39 () {54 vars in 930 bytes} [Wed Jul 13 20:57:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 20:57:34.716672 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-2091e1c3-a60c-425b-a15d-fb2eb439de7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "disk": 10, "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0, "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3"}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 20:57:34.745636 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-2091e1c3-a60c-425b-a15d-fb2eb439de7b admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.446306 Jul 13 20:57:34.746176 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 7/14] 10.222.0.39 () {64 vars in 1282 bytes} [Wed Jul 13 20:57:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 20:57:34.763859 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-ef8e400e-18bc-4290-aae5-00b60166fe82 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 20:57:34.797235 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-ef8e400e-18bc-4290-aae5-00b60166fe82 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036956 Jul 13 20:57:34.802385 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 8/15] 10.222.0.39 () {64 vars in 1335 bytes} [Wed Jul 13 20:57:34 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 20:57:37.027500 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-2091e1c3-a60c-425b-a15d-fb2eb439de7b admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:57:37.028767 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-2091e1c3-a60c-425b-a15d-fb2eb439de7b admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jul 13 20:57:37.029334 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 8/16] 10.222.0.39 () {54 vars in 930 bytes} [Wed Jul 13 20:57:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 20:57:37.462011 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-81d70631-d649-41f0-8288-44e0ae8b0b19 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "disk": 20, "name": "ds4G", "ram": 4096}} {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 20:57:37.480539 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-81d70631-d649-41f0-8288-44e0ae8b0b19 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.445837 Jul 13 20:57:37.481340 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 9/17] 10.222.0.39 () {64 vars in 1282 bytes} [Wed Jul 13 20:57:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 20:57:37.493308 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-52770105-cb06-4061-91d8-66ce15e30696 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 20:57:37.517766 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-52770105-cb06-4061-91d8-66ce15e30696 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028552 Jul 13 20:57:37.518333 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 9/18] 10.222.0.39 () {64 vars in 1335 bytes} [Wed Jul 13 20:57:37 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 20:57:39.947934 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-81d70631-d649-41f0-8288-44e0ae8b0b19 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:57:39.948956 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-81d70631-d649-41f0-8288-44e0ae8b0b19 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jul 13 20:57:39.949354 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 10/19] 10.222.0.39 () {54 vars in 930 bytes} [Wed Jul 13 20:57:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 20:57:40.474068 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-2d166a70-a387-43d3-9661-fb40e9bcc656 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:57:40.496952 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-2d166a70-a387-43d3-9661-fb40e9bcc656 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.541732 Jul 13 20:57:40.497494 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 10/20] 10.222.0.39 () {60 vars in 1291 bytes} [Wed Jul 13 20:57:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 20:57:42.751242 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-81d70631-d649-41f0-8288-44e0ae8b0b19 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:57:42.752248 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-81d70631-d649-41f0-8288-44e0ae8b0b19 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jul 13 20:57:42.752640 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 11/21] 10.222.0.39 () {54 vars in 930 bytes} [Wed Jul 13 20:57:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 20:57:43.181943 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-ebe47a68-3ab7-4776-88fb-4f3c116164c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "ram": 512}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 20:57:43.202010 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-ebe47a68-3ab7-4776-88fb-4f3c116164c7 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.443608 Jul 13 20:57:43.202545 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 11/22] 10.222.0.39 () {64 vars in 1282 bytes} [Wed Jul 13 20:57:42 2022] POST /compute/v2.1/flavors => generated 402 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 20:57:43.214803 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-f10275bb-89c1-43ab-8b34-a89ba42352b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 20:57:43.240962 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-f10275bb-89c1-43ab-8b34-a89ba42352b8 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029608 Jul 13 20:57:43.242295 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 12/23] 10.222.0.39 () {64 vars in 1332 bytes} [Wed Jul 13 20:57:43 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 20:57:45.487783 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-ebe47a68-3ab7-4776-88fb-4f3c116164c7 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:57:45.488794 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-ebe47a68-3ab7-4776-88fb-4f3c116164c7 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jul 13 20:57:45.489372 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 12/24] 10.222.0.39 () {54 vars in 930 bytes} [Wed Jul 13 20:57:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 20:57:45.880322 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-e668b157-daff-4914-a81b-dee1dce85d51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "2", "ram": 2048, "vcpus": 1}} {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 20:57:45.899361 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-e668b157-daff-4914-a81b-dee1dce85d51 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.403748 Jul 13 20:57:45.899909 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 13/25] 10.222.0.39 () {64 vars in 1282 bytes} [Wed Jul 13 20:57:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 20:57:45.912084 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-ee963adc-f6d2-4a7b-9b13-b02eb41430ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 20:57:45.934284 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-ee963adc-f6d2-4a7b-9b13-b02eb41430ec admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025791 Jul 13 20:57:45.935006 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 13/26] 10.222.0.39 () {64 vars in 1332 bytes} [Wed Jul 13 20:57:45 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 20:57:48.142138 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-e668b157-daff-4914-a81b-dee1dce85d51 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:57:48.143182 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-e668b157-daff-4914-a81b-dee1dce85d51 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jul 13 20:57:48.143574 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 14/27] 10.222.0.39 () {54 vars in 930 bytes} [Wed Jul 13 20:57:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 20:57:48.529506 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-7ffda399-bdb5-4f56-a74a-ff8b9105c8b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "3", "disk": 40, "vcpus": 2, "os-flavor-access:is_public": true, "name": "m1.medium", "rxtx_factor": 1.0, "ram": 4096}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 20:57:48.547567 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-7ffda399-bdb5-4f56-a74a-ff8b9105c8b3 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.398076 Jul 13 20:57:48.548115 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 14/28] 10.222.0.39 () {64 vars in 1282 bytes} [Wed Jul 13 20:57:48 2022] POST /compute/v2.1/flavors => generated 406 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 20:57:48.560405 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-108bed73-9cdc-4f4d-9624-127c1202229c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 20:57:48.583582 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-108bed73-9cdc-4f4d-9624-127c1202229c admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027306 Jul 13 20:57:48.584409 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 15/29] 10.222.0.39 () {64 vars in 1332 bytes} [Wed Jul 13 20:57:48 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 20:57:50.830411 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-7ffda399-bdb5-4f56-a74a-ff8b9105c8b3 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:57:50.831468 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-7ffda399-bdb5-4f56-a74a-ff8b9105c8b3 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jul 13 20:57:50.831873 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 15/30] 10.222.0.39 () {54 vars in 930 bytes} [Wed Jul 13 20:57:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 20:57:51.298422 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-7c7b3f1c-c99d-47bd-a253-688006497c12 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "rxtx_factor": 1.0, "ram": 8192, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "4", "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 20:57:51.317246 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-7c7b3f1c-c99d-47bd-a253-688006497c12 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.478537 Jul 13 20:57:51.317874 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 16/31] 10.222.0.39 () {64 vars in 1282 bytes} [Wed Jul 13 20:57:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 20:57:51.329456 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-db5a35d6-4e7d-4b40-a121-7cfaa3285ce2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 20:57:51.352839 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-db5a35d6-4e7d-4b40-a121-7cfaa3285ce2 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026921 Jul 13 20:57:51.362645 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 16/32] 10.222.0.39 () {64 vars in 1332 bytes} [Wed Jul 13 20:57:51 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 20:57:53.552199 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-7c7b3f1c-c99d-47bd-a253-688006497c12 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:57:53.553155 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-7c7b3f1c-c99d-47bd-a253-688006497c12 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jul 13 20:57:53.553819 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 17/33] 10.222.0.39 () {54 vars in 930 bytes} [Wed Jul 13 20:57:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 20:57:53.987948 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-e69693ee-bcbb-428a-afa7-aa9863ad3d71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "id": "5", "vcpus": 8, "rxtx_factor": 1.0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "ram": 16384, "swap": 0}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 20:57:54.007462 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-e69693ee-bcbb-428a-afa7-aa9863ad3d71 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.446005 Jul 13 20:57:54.008263 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 17/34] 10.222.0.39 () {64 vars in 1282 bytes} [Wed Jul 13 20:57:53 2022] POST /compute/v2.1/flavors => generated 408 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 20:57:54.020111 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-7232c55f-991a-438d-992b-2d05b3353b22 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 20:57:54.023952 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG dbcounter [-] [103949] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:57:54.051512 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-7232c55f-991a-438d-992b-2d05b3353b22 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035077 Jul 13 20:57:54.052198 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 18/35] 10.222.0.39 () {64 vars in 1332 bytes} [Wed Jul 13 20:57:54 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 20:58:13.299631 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-e69693ee-bcbb-428a-afa7-aa9863ad3d71 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:58:13.300645 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-e69693ee-bcbb-428a-afa7-aa9863ad3d71 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jul 13 20:58:13.301038 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 18/36] 10.222.0.39 () {54 vars in 930 bytes} [Wed Jul 13 20:58:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 20:58:13.311471 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG dbcounter [-] [103949] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:58:13.683407 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-64e46908-3a8e-459f-a726-02e42b18a112 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:58:13.700351 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-64e46908-3a8e-459f-a726-02e42b18a112 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.393468 Jul 13 20:58:13.700873 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 19/37] 10.222.0.39 () {60 vars in 1291 bytes} [Wed Jul 13 20:58:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 20:58:14.751340 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-e69693ee-bcbb-428a-afa7-aa9863ad3d71 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:58:14.752347 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-e69693ee-bcbb-428a-afa7-aa9863ad3d71 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 13 20:58:14.752742 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 19/38] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Jul 13 20:58:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 20:58:15.264109 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-e77620ea-acd7-42f8-8712-b32777081ef3 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:58:15.269716 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.wsgi [None req-e77620ea-acd7-42f8-8712-b32777081ef3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 13 20:58:15.272980 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-e77620ea-acd7-42f8-8712-b32777081ef3 admin admin] Request method failure captured: Jul 13 20:58:15.272980 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 13 20:58:15.272980 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: Accept: application/json Jul 13 20:58:15.272980 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: Accept-Encoding: gzip, deflate Jul 13 20:58:15.272980 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: Connection: keep-alive Jul 13 20:58:15.272980 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: Content-Length: 0 Jul 13 20:58:15.272980 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: Host: 10.222.0.39 Jul 13 20:58:15.272980 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: Openstack-Api-Version: compute 2.90 Jul 13 20:58:15.272980 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: Openstack-System-Scope: None Jul 13 20:58:15.272980 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: User-Agent: python-novaclient Jul 13 20:58:15.272980 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Auth-Token: gAAAAABizzHmm9eHL3Ao7RwcU3D1b33NYgyP515l8qIeBCSobApZtd3B76yQckdB3J4KAiKJDLdFF4E3Iku7ByzVkBfFi0E7H5Wv1RL1HpzfwoiIGVXfIv7rT_rbKAJmws7dQcdAqILjXh_HCn3IfnwmFMs0wbBRu7VtRrPjHDpDIGFgpawfj8A Jul 13 20:58:15.272980 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Domain-Id: None Jul 13 20:58:15.272980 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Domain-Name: None Jul 13 20:58:15.272980 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Identity-Status: Confirmed Jul 13 20:58:15.272980 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Is-Admin-Project: True Jul 13 20:58:15.272980 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Openstack-Nova-Api-Version: 2.90 Jul 13 20:58:15.272980 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Project-Domain-Id: default Jul 13 20:58:15.272980 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Project-Domain-Name: Default Jul 13 20:58:15.272980 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Project-Id: c113e9e1592248a9b12fd4d2b385aa5a Jul 13 20:58:15.272980 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Project-Name: admin Jul 13 20:58:15.272980 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Role: member,reader,admin Jul 13 20:58:15.272980 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Roles: member,reader,admin Jul 13 20:58:15.275151 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c113e9e1592248a9b12fd4d2b385aa5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c113e9e1592248a9b12fd4d2b385aa5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c113e9e1592248a9b12fd4d2b385aa5a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c113e9e1592248a9b12fd4d2b385aa5a"}]}] Jul 13 20:58:15.275151 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Tenant: admin Jul 13 20:58:15.275151 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Tenant-Id: c113e9e1592248a9b12fd4d2b385aa5a Jul 13 20:58:15.275151 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Tenant-Name: admin Jul 13 20:58:15.275151 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-User: admin Jul 13 20:58:15.275151 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-User-Domain-Id: default Jul 13 20:58:15.275151 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-User-Domain-Name: Default Jul 13 20:58:15.275151 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-User-Id: a762106a78c649808cb7ea162b5997db Jul 13 20:58:15.275151 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-User-Name: admin Jul 13 20:58:15.275151 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: method: > Jul 13 20:58:15.275151 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: exception: Flavor 42 could not be found. Jul 13 20:58:15.275151 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: action_args: {'id': '42'} Jul 13 20:58:15.275151 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 20:58:15.275151 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 20:58:15.275974 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 13 20:58:15.275974 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 13 20:58:15.275974 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 13 20:58:15.275974 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 13 20:58:15.275974 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 13 20:58:15.275974 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 13 20:58:15.275974 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 13 20:58:15.275974 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 13 20:58:15.275974 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 13 20:58:15.275974 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 20:58:15.275974 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 13 20:58:15.275974 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 13 20:58:15.275974 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 13 20:58:15.275974 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Jul 13 20:58:15.275974 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 20:58:15.275974 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Jul 13 20:58:15.275974 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 20:58:15.275974 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 20:58:15.275974 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 20:58:15.277169 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 20:58:15.277169 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 20:58:15.277169 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 20:58:15.277169 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 20:58:15.277169 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 13 20:58:15.277169 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 13 20:58:15.277169 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 13 20:58:15.277169 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Jul 13 20:58:15.277169 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 20:58:15.277169 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Jul 13 20:58:15.277169 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 20:58:15.277169 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 20:58:15.277169 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 20:58:15.277169 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 20:58:15.277169 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 20:58:15.277169 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 13 20:58:15.277169 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Jul 13 20:58:15.277169 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-e77620ea-acd7-42f8-8712-b32777081ef3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 20:58:15.278737 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-e77620ea-acd7-42f8-8712-b32777081ef3 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.386033 Jul 13 20:58:15.278737 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 20/39] 10.222.0.39 () {60 vars in 1190 bytes} [Wed Jul 13 20:58:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 13 20:58:15.284810 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-b6facacd-c855-404e-b914-976fb7aeab07 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:58:15.287659 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:58:15.307079 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-b6facacd-c855-404e-b914-976fb7aeab07 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025775 Jul 13 20:58:15.307608 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 20/40] 10.222.0.39 () {60 vars in 1210 bytes} [Wed Jul 13 20:58:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 20:58:15.317360 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-57909cf7-07df-4add-9fa1-51f9c6dfa2ec admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:58:15.339239 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-57909cf7-07df-4add-9fa1-51f9c6dfa2ec admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025469 Jul 13 20:58:15.339748 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 21/41] 10.222.0.39 () {60 vars in 1210 bytes} [Wed Jul 13 20:58:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 20:58:15.349407 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-7b1a9379-d120-4ce6-99ef-1975e928da72 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:58:15.355567 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.wsgi [None req-7b1a9379-d120-4ce6-99ef-1975e928da72 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 13 20:58:15.358845 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-7b1a9379-d120-4ce6-99ef-1975e928da72 admin admin] Request method failure captured: Jul 13 20:58:15.358845 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 13 20:58:15.358845 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: Accept: application/json Jul 13 20:58:15.358845 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: Accept-Encoding: gzip, deflate Jul 13 20:58:15.358845 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: Connection: keep-alive Jul 13 20:58:15.358845 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: Content-Length: 0 Jul 13 20:58:15.358845 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: Host: 10.222.0.39 Jul 13 20:58:15.358845 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: Openstack-Api-Version: compute 2.90 Jul 13 20:58:15.358845 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: Openstack-System-Scope: None Jul 13 20:58:15.358845 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: User-Agent: python-novaclient Jul 13 20:58:15.358845 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Auth-Token: gAAAAABizzHmm9eHL3Ao7RwcU3D1b33NYgyP515l8qIeBCSobApZtd3B76yQckdB3J4KAiKJDLdFF4E3Iku7ByzVkBfFi0E7H5Wv1RL1HpzfwoiIGVXfIv7rT_rbKAJmws7dQcdAqILjXh_HCn3IfnwmFMs0wbBRu7VtRrPjHDpDIGFgpawfj8A Jul 13 20:58:15.358845 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Domain-Id: None Jul 13 20:58:15.358845 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Domain-Name: None Jul 13 20:58:15.358845 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Identity-Status: Confirmed Jul 13 20:58:15.358845 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Is-Admin-Project: True Jul 13 20:58:15.358845 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Openstack-Nova-Api-Version: 2.90 Jul 13 20:58:15.358845 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Project-Domain-Id: default Jul 13 20:58:15.358845 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Project-Domain-Name: Default Jul 13 20:58:15.358845 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Project-Id: c113e9e1592248a9b12fd4d2b385aa5a Jul 13 20:58:15.358845 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Project-Name: admin Jul 13 20:58:15.358845 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Role: member,reader,admin Jul 13 20:58:15.358845 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Roles: member,reader,admin Jul 13 20:58:15.360382 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c113e9e1592248a9b12fd4d2b385aa5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c113e9e1592248a9b12fd4d2b385aa5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c113e9e1592248a9b12fd4d2b385aa5a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c113e9e1592248a9b12fd4d2b385aa5a"}]}] Jul 13 20:58:15.360382 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Tenant: admin Jul 13 20:58:15.360382 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Tenant-Id: c113e9e1592248a9b12fd4d2b385aa5a Jul 13 20:58:15.360382 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Tenant-Name: admin Jul 13 20:58:15.360382 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-User: admin Jul 13 20:58:15.360382 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-User-Domain-Id: default Jul 13 20:58:15.360382 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-User-Domain-Name: Default Jul 13 20:58:15.360382 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-User-Id: a762106a78c649808cb7ea162b5997db Jul 13 20:58:15.360382 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-User-Name: admin Jul 13 20:58:15.360382 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: method: > Jul 13 20:58:15.360382 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: exception: Flavor 42 could not be found. Jul 13 20:58:15.360382 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: action_args: {'id': '42'} Jul 13 20:58:15.360382 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 20:58:15.360382 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 20:58:15.361449 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 13 20:58:15.361449 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 13 20:58:15.361449 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 13 20:58:15.361449 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 13 20:58:15.361449 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 13 20:58:15.361449 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 13 20:58:15.361449 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 13 20:58:15.361449 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 13 20:58:15.361449 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 13 20:58:15.361449 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 20:58:15.361449 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 13 20:58:15.361449 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 13 20:58:15.361449 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 13 20:58:15.361449 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Jul 13 20:58:15.361449 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 20:58:15.361449 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Jul 13 20:58:15.361449 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 20:58:15.361449 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 20:58:15.361449 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 20:58:15.362841 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 20:58:15.362841 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 20:58:15.362841 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 20:58:15.362841 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 20:58:15.362841 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 13 20:58:15.362841 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 13 20:58:15.362841 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 13 20:58:15.362841 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Jul 13 20:58:15.362841 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 20:58:15.362841 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Jul 13 20:58:15.362841 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 20:58:15.362841 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 20:58:15.362841 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 20:58:15.362841 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 20:58:15.362841 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 20:58:15.362841 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 13 20:58:15.362841 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Jul 13 20:58:15.362841 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-7b1a9379-d120-4ce6-99ef-1975e928da72 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 20:58:15.364062 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-7b1a9379-d120-4ce6-99ef-1975e928da72 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015077 Jul 13 20:58:15.364062 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 21/42] 10.222.0.39 () {60 vars in 1190 bytes} [Wed Jul 13 20:58:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 13 20:58:16.314470 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-57909cf7-07df-4add-9fa1-51f9c6dfa2ec admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:58:16.315513 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-57909cf7-07df-4add-9fa1-51f9c6dfa2ec admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 13 20:58:16.315909 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 22/43] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Jul 13 20:58:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 20:58:16.823498 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-91a73be9-0f61-4430-9001-ad7c7486366c admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:58:16.829324 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.wsgi [None req-91a73be9-0f61-4430-9001-ad7c7486366c admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 13 20:58:16.830864 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-91a73be9-0f61-4430-9001-ad7c7486366c admin admin] Request method failure captured: Jul 13 20:58:16.830864 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 13 20:58:16.830864 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: Accept: application/json Jul 13 20:58:16.830864 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: Accept-Encoding: gzip, deflate Jul 13 20:58:16.830864 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: Connection: keep-alive Jul 13 20:58:16.830864 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: Content-Length: 0 Jul 13 20:58:16.830864 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: Host: 10.222.0.39 Jul 13 20:58:16.830864 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: Openstack-Api-Version: compute 2.90 Jul 13 20:58:16.830864 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: Openstack-System-Scope: None Jul 13 20:58:16.830864 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: User-Agent: python-novaclient Jul 13 20:58:16.830864 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Auth-Token: gAAAAABizzHoIU_F73yH7DX8533Ph3DNK6nlSGACUziKF_5YiIX-u5JhvPlDDqAkdUrCV_ieDUhdvC27x9Xl1U8TevKGJen0jUH-iAiu76mkyVmMYY5s2DLfjk7tjHFkFTMcu5_tGNB1jVsV3JYL-3QsVcJ08QPXjjLbRjr3Y-tGxqo8kPqhFVg Jul 13 20:58:16.830864 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Domain-Id: None Jul 13 20:58:16.830864 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Domain-Name: None Jul 13 20:58:16.830864 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Identity-Status: Confirmed Jul 13 20:58:16.830864 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Is-Admin-Project: True Jul 13 20:58:16.830864 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Openstack-Nova-Api-Version: 2.90 Jul 13 20:58:16.830864 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Project-Domain-Id: default Jul 13 20:58:16.830864 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Project-Domain-Name: Default Jul 13 20:58:16.830864 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Project-Id: c113e9e1592248a9b12fd4d2b385aa5a Jul 13 20:58:16.830864 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Project-Name: admin Jul 13 20:58:16.830864 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Role: member,reader,admin Jul 13 20:58:16.830864 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Roles: member,reader,admin Jul 13 20:58:16.832365 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c113e9e1592248a9b12fd4d2b385aa5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c113e9e1592248a9b12fd4d2b385aa5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c113e9e1592248a9b12fd4d2b385aa5a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c113e9e1592248a9b12fd4d2b385aa5a"}]}] Jul 13 20:58:16.832365 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Tenant: admin Jul 13 20:58:16.832365 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Tenant-Id: c113e9e1592248a9b12fd4d2b385aa5a Jul 13 20:58:16.832365 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Tenant-Name: admin Jul 13 20:58:16.832365 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-User: admin Jul 13 20:58:16.832365 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-User-Domain-Id: default Jul 13 20:58:16.832365 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-User-Domain-Name: Default Jul 13 20:58:16.832365 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-User-Id: a762106a78c649808cb7ea162b5997db Jul 13 20:58:16.832365 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-User-Name: admin Jul 13 20:58:16.832365 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: method: > Jul 13 20:58:16.832365 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: exception: Flavor 84 could not be found. Jul 13 20:58:16.832365 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: action_args: {'id': '84'} Jul 13 20:58:16.832365 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 20:58:16.832365 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 20:58:16.833359 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 13 20:58:16.833359 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 13 20:58:16.833359 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 13 20:58:16.833359 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 13 20:58:16.833359 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 13 20:58:16.833359 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 13 20:58:16.833359 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 13 20:58:16.833359 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 13 20:58:16.833359 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 13 20:58:16.833359 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 20:58:16.833359 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 13 20:58:16.833359 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 13 20:58:16.833359 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 13 20:58:16.833359 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Jul 13 20:58:16.833359 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 20:58:16.833359 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Jul 13 20:58:16.833359 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 20:58:16.833359 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 20:58:16.833359 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 20:58:16.834709 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 20:58:16.834709 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 20:58:16.834709 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 20:58:16.834709 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 20:58:16.834709 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 13 20:58:16.834709 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 13 20:58:16.834709 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 13 20:58:16.834709 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Jul 13 20:58:16.834709 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 20:58:16.834709 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Jul 13 20:58:16.834709 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 20:58:16.834709 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 20:58:16.834709 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 20:58:16.834709 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 20:58:16.834709 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 20:58:16.834709 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 13 20:58:16.834709 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Jul 13 20:58:16.834709 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-91a73be9-0f61-4430-9001-ad7c7486366c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 20:58:16.835958 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-91a73be9-0f61-4430-9001-ad7c7486366c admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.382268 Jul 13 20:58:16.835958 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 22/44] 10.222.0.39 () {60 vars in 1190 bytes} [Wed Jul 13 20:58:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 383 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 13 20:58:16.842272 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-3d530d3b-da84-4826-a1ff-848f2aced0b2 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:58:16.855650 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-3d530d3b-da84-4826-a1ff-848f2aced0b2 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016955 Jul 13 20:58:16.856165 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 23/45] 10.222.0.39 () {60 vars in 1210 bytes} [Wed Jul 13 20:58:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 20:58:16.865047 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-683fd76c-5e36-4a84-8bf3-3338266245d0 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:58:16.878262 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-683fd76c-5e36-4a84-8bf3-3338266245d0 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016566 Jul 13 20:58:16.878839 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 23/46] 10.222.0.39 () {60 vars in 1210 bytes} [Wed Jul 13 20:58:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 20:58:16.888072 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-31fc4405-116c-47f3-85f5-970503bbb7d8 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:58:16.893337 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.wsgi [None req-31fc4405-116c-47f3-85f5-970503bbb7d8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 13 20:58:16.894876 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-31fc4405-116c-47f3-85f5-970503bbb7d8 admin admin] Request method failure captured: Jul 13 20:58:16.894876 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 13 20:58:16.894876 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: Accept: application/json Jul 13 20:58:16.894876 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: Accept-Encoding: gzip, deflate Jul 13 20:58:16.894876 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: Connection: keep-alive Jul 13 20:58:16.894876 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: Content-Length: 0 Jul 13 20:58:16.894876 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: Host: 10.222.0.39 Jul 13 20:58:16.894876 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: Openstack-Api-Version: compute 2.90 Jul 13 20:58:16.894876 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: Openstack-System-Scope: None Jul 13 20:58:16.894876 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: User-Agent: python-novaclient Jul 13 20:58:16.894876 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Auth-Token: gAAAAABizzHoIU_F73yH7DX8533Ph3DNK6nlSGACUziKF_5YiIX-u5JhvPlDDqAkdUrCV_ieDUhdvC27x9Xl1U8TevKGJen0jUH-iAiu76mkyVmMYY5s2DLfjk7tjHFkFTMcu5_tGNB1jVsV3JYL-3QsVcJ08QPXjjLbRjr3Y-tGxqo8kPqhFVg Jul 13 20:58:16.894876 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Domain-Id: None Jul 13 20:58:16.894876 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Domain-Name: None Jul 13 20:58:16.894876 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Identity-Status: Confirmed Jul 13 20:58:16.894876 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Is-Admin-Project: True Jul 13 20:58:16.894876 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Openstack-Nova-Api-Version: 2.90 Jul 13 20:58:16.894876 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Project-Domain-Id: default Jul 13 20:58:16.894876 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Project-Domain-Name: Default Jul 13 20:58:16.894876 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Project-Id: c113e9e1592248a9b12fd4d2b385aa5a Jul 13 20:58:16.894876 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Project-Name: admin Jul 13 20:58:16.894876 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Role: member,reader,admin Jul 13 20:58:16.894876 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Roles: member,reader,admin Jul 13 20:58:16.896401 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c113e9e1592248a9b12fd4d2b385aa5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c113e9e1592248a9b12fd4d2b385aa5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c113e9e1592248a9b12fd4d2b385aa5a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c113e9e1592248a9b12fd4d2b385aa5a"}]}] Jul 13 20:58:16.896401 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Tenant: admin Jul 13 20:58:16.896401 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Tenant-Id: c113e9e1592248a9b12fd4d2b385aa5a Jul 13 20:58:16.896401 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Tenant-Name: admin Jul 13 20:58:16.896401 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-User: admin Jul 13 20:58:16.896401 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-User-Domain-Id: default Jul 13 20:58:16.896401 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-User-Domain-Name: Default Jul 13 20:58:16.896401 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-User-Id: a762106a78c649808cb7ea162b5997db Jul 13 20:58:16.896401 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-User-Name: admin Jul 13 20:58:16.896401 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: method: > Jul 13 20:58:16.896401 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: exception: Flavor 84 could not be found. Jul 13 20:58:16.896401 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: action_args: {'id': '84'} Jul 13 20:58:16.896401 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 20:58:16.896401 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 20:58:16.897328 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 13 20:58:16.897328 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 13 20:58:16.897328 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 13 20:58:16.897328 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 13 20:58:16.897328 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 13 20:58:16.897328 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 13 20:58:16.897328 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 13 20:58:16.897328 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 13 20:58:16.897328 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 13 20:58:16.897328 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 20:58:16.897328 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 13 20:58:16.897328 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 13 20:58:16.897328 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 13 20:58:16.897328 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Jul 13 20:58:16.897328 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 20:58:16.897328 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Jul 13 20:58:16.897328 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 20:58:16.897328 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 20:58:16.897328 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 20:58:16.898412 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 20:58:16.898412 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 20:58:16.898412 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 20:58:16.898412 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 20:58:16.898412 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 13 20:58:16.898412 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 13 20:58:16.898412 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 13 20:58:16.898412 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Jul 13 20:58:16.898412 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 20:58:16.898412 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Jul 13 20:58:16.898412 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 20:58:16.898412 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 20:58:16.898412 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 20:58:16.898412 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 20:58:16.898412 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 20:58:16.898412 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 13 20:58:16.898412 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Jul 13 20:58:16.898412 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-31fc4405-116c-47f3-85f5-970503bbb7d8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 20:58:16.899435 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-31fc4405-116c-47f3-85f5-970503bbb7d8 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012073 Jul 13 20:58:16.899435 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 24/47] 10.222.0.39 () {60 vars in 1190 bytes} [Wed Jul 13 20:58:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 13 20:58:17.852322 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-683fd76c-5e36-4a84-8bf3-3338266245d0 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:58:17.853322 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-683fd76c-5e36-4a84-8bf3-3338266245d0 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jul 13 20:58:17.853710 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 24/48] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Jul 13 20:58:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 20:58:18.369616 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-f697403b-74e6-48e0-983a-36e5362b15bc admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:58:18.375297 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.wsgi [None req-f697403b-74e6-48e0-983a-36e5362b15bc admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 13 20:58:18.376773 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-f697403b-74e6-48e0-983a-36e5362b15bc admin admin] Request method failure captured: Jul 13 20:58:18.376773 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 13 20:58:18.376773 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: Accept: application/json Jul 13 20:58:18.376773 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: Accept-Encoding: gzip, deflate Jul 13 20:58:18.376773 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: Connection: keep-alive Jul 13 20:58:18.376773 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: Content-Length: 0 Jul 13 20:58:18.376773 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: Host: 10.222.0.39 Jul 13 20:58:18.376773 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: Openstack-Api-Version: compute 2.90 Jul 13 20:58:18.376773 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: Openstack-System-Scope: None Jul 13 20:58:18.376773 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: User-Agent: python-novaclient Jul 13 20:58:18.376773 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Auth-Token: gAAAAABizzHpIccUEL-FIYr85HOf5gDRn0MKwVHGVquH_J_TJ4wY3z9ZglblUNedzvjysgXgGtqNFA4HOG95de9H0mp1QEb9FIiPx_MxCxU7BOSiOggfXR-z9sMueouf-FmqyDngTlY7EZfwi6xKcXO5PXO46Fj6jUWYemy4gPitUYzstIsWmoc Jul 13 20:58:18.376773 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Domain-Id: None Jul 13 20:58:18.376773 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Domain-Name: None Jul 13 20:58:18.376773 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Identity-Status: Confirmed Jul 13 20:58:18.376773 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Is-Admin-Project: True Jul 13 20:58:18.376773 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Openstack-Nova-Api-Version: 2.90 Jul 13 20:58:18.376773 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Project-Domain-Id: default Jul 13 20:58:18.376773 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Project-Domain-Name: Default Jul 13 20:58:18.376773 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Project-Id: c113e9e1592248a9b12fd4d2b385aa5a Jul 13 20:58:18.376773 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Project-Name: admin Jul 13 20:58:18.376773 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Role: member,reader,admin Jul 13 20:58:18.376773 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Roles: member,reader,admin Jul 13 20:58:18.378441 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c113e9e1592248a9b12fd4d2b385aa5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c113e9e1592248a9b12fd4d2b385aa5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c113e9e1592248a9b12fd4d2b385aa5a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c113e9e1592248a9b12fd4d2b385aa5a"}]}] Jul 13 20:58:18.378441 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Tenant: admin Jul 13 20:58:18.378441 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Tenant-Id: c113e9e1592248a9b12fd4d2b385aa5a Jul 13 20:58:18.378441 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-Tenant-Name: admin Jul 13 20:58:18.378441 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-User: admin Jul 13 20:58:18.378441 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-User-Domain-Id: default Jul 13 20:58:18.378441 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-User-Domain-Name: Default Jul 13 20:58:18.378441 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-User-Id: a762106a78c649808cb7ea162b5997db Jul 13 20:58:18.378441 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: X-User-Name: admin Jul 13 20:58:18.378441 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: method: > Jul 13 20:58:18.378441 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: exception: Flavor 451 could not be found. Jul 13 20:58:18.378441 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: action_args: {'id': '451'} Jul 13 20:58:18.378441 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 20:58:18.378441 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 20:58:18.379618 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 13 20:58:18.379618 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 13 20:58:18.379618 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 13 20:58:18.379618 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 13 20:58:18.379618 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 13 20:58:18.379618 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 13 20:58:18.379618 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 13 20:58:18.379618 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 13 20:58:18.379618 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 13 20:58:18.379618 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 20:58:18.379618 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 13 20:58:18.379618 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 13 20:58:18.379618 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 13 20:58:18.379618 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Jul 13 20:58:18.379618 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 20:58:18.379618 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Jul 13 20:58:18.379618 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 20:58:18.379618 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 20:58:18.379618 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 20:58:18.380925 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 20:58:18.380925 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 20:58:18.380925 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 20:58:18.380925 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 20:58:18.380925 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 13 20:58:18.380925 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 13 20:58:18.380925 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 13 20:58:18.380925 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Jul 13 20:58:18.380925 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 20:58:18.380925 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Jul 13 20:58:18.380925 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 20:58:18.380925 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 20:58:18.380925 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 20:58:18.380925 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 20:58:18.380925 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 20:58:18.380925 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 13 20:58:18.380925 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Jul 13 20:58:18.380925 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-f697403b-74e6-48e0-983a-36e5362b15bc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 20:58:18.382140 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-f697403b-74e6-48e0-983a-36e5362b15bc admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.389709 Jul 13 20:58:18.382140 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 25/49] 10.222.0.39 () {60 vars in 1193 bytes} [Wed Jul 13 20:58:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 13 20:58:18.387486 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-44562a30-012c-4653-acac-0d47caa47e54 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:58:18.400703 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-44562a30-012c-4653-acac-0d47caa47e54 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016736 Jul 13 20:58:18.401210 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 25/50] 10.222.0.39 () {60 vars in 1210 bytes} [Wed Jul 13 20:58:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 20:58:18.410200 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-075fa0df-e439-4301-8fe9-7563b3d61870 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:58:18.425197 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-075fa0df-e439-4301-8fe9-7563b3d61870 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018398 Jul 13 20:58:18.425700 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 26/51] 10.222.0.39 () {60 vars in 1210 bytes} [Wed Jul 13 20:58:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 20:58:18.435204 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-d50aac84-da76-42b9-86d0-dc40de7c0316 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:58:18.440379 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.wsgi [None req-d50aac84-da76-42b9-86d0-dc40de7c0316 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 13 20:58:18.441848 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-d50aac84-da76-42b9-86d0-dc40de7c0316 admin admin] Request method failure captured: Jul 13 20:58:18.441848 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 13 20:58:18.441848 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: Accept: application/json Jul 13 20:58:18.441848 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: Accept-Encoding: gzip, deflate Jul 13 20:58:18.441848 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: Connection: keep-alive Jul 13 20:58:18.441848 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: Content-Length: 0 Jul 13 20:58:18.441848 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: Host: 10.222.0.39 Jul 13 20:58:18.441848 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: Openstack-Api-Version: compute 2.90 Jul 13 20:58:18.441848 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: Openstack-System-Scope: None Jul 13 20:58:18.441848 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: User-Agent: python-novaclient Jul 13 20:58:18.441848 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Auth-Token: gAAAAABizzHpIccUEL-FIYr85HOf5gDRn0MKwVHGVquH_J_TJ4wY3z9ZglblUNedzvjysgXgGtqNFA4HOG95de9H0mp1QEb9FIiPx_MxCxU7BOSiOggfXR-z9sMueouf-FmqyDngTlY7EZfwi6xKcXO5PXO46Fj6jUWYemy4gPitUYzstIsWmoc Jul 13 20:58:18.441848 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Domain-Id: None Jul 13 20:58:18.441848 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Domain-Name: None Jul 13 20:58:18.441848 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Identity-Status: Confirmed Jul 13 20:58:18.441848 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Is-Admin-Project: True Jul 13 20:58:18.441848 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Openstack-Nova-Api-Version: 2.90 Jul 13 20:58:18.441848 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Project-Domain-Id: default Jul 13 20:58:18.441848 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Project-Domain-Name: Default Jul 13 20:58:18.441848 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Project-Id: c113e9e1592248a9b12fd4d2b385aa5a Jul 13 20:58:18.441848 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Project-Name: admin Jul 13 20:58:18.441848 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Role: member,reader,admin Jul 13 20:58:18.441848 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Roles: member,reader,admin Jul 13 20:58:18.443528 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c113e9e1592248a9b12fd4d2b385aa5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c113e9e1592248a9b12fd4d2b385aa5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c113e9e1592248a9b12fd4d2b385aa5a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c113e9e1592248a9b12fd4d2b385aa5a"}]}] Jul 13 20:58:18.443528 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Tenant: admin Jul 13 20:58:18.443528 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Tenant-Id: c113e9e1592248a9b12fd4d2b385aa5a Jul 13 20:58:18.443528 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-Tenant-Name: admin Jul 13 20:58:18.443528 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-User: admin Jul 13 20:58:18.443528 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-User-Domain-Id: default Jul 13 20:58:18.443528 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-User-Domain-Name: Default Jul 13 20:58:18.443528 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-User-Id: a762106a78c649808cb7ea162b5997db Jul 13 20:58:18.443528 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: X-User-Name: admin Jul 13 20:58:18.443528 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: method: > Jul 13 20:58:18.443528 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: exception: Flavor 451 could not be found. Jul 13 20:58:18.443528 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: action_args: {'id': '451'} Jul 13 20:58:18.443528 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 20:58:18.443528 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 20:58:18.444375 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 13 20:58:18.444375 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 13 20:58:18.444375 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 13 20:58:18.444375 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 13 20:58:18.444375 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 13 20:58:18.444375 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 13 20:58:18.444375 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 13 20:58:18.444375 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 13 20:58:18.444375 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 13 20:58:18.444375 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 20:58:18.444375 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 13 20:58:18.444375 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 13 20:58:18.444375 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 13 20:58:18.444375 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Jul 13 20:58:18.444375 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 20:58:18.444375 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Jul 13 20:58:18.444375 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 20:58:18.444375 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 20:58:18.444375 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 20:58:18.445407 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 20:58:18.445407 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 20:58:18.445407 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 20:58:18.445407 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 20:58:18.445407 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 13 20:58:18.445407 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 13 20:58:18.445407 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 13 20:58:18.445407 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Jul 13 20:58:18.445407 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 20:58:18.445407 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Jul 13 20:58:18.445407 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 20:58:18.445407 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 20:58:18.445407 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 20:58:18.445407 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 20:58:18.445407 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 20:58:18.445407 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 13 20:58:18.445407 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Jul 13 20:58:18.445407 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-d50aac84-da76-42b9-86d0-dc40de7c0316 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 20:58:18.446470 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-d50aac84-da76-42b9-86d0-dc40de7c0316 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012040 Jul 13 20:58:18.446470 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 26/52] 10.222.0.39 () {60 vars in 1193 bytes} [Wed Jul 13 20:58:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 13 20:58:19.401938 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-075fa0df-e439-4301-8fe9-7563b3d61870 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:58:19.402981 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-075fa0df-e439-4301-8fe9-7563b3d61870 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 13 20:58:19.403367 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 27/53] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Jul 13 20:58:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 20:58:19.916686 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-a3aa5b30-0ebc-441a-9f47-935560440776 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 20:58:19.934313 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-a3aa5b30-0ebc-441a-9f47-935560440776 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.394380 Jul 13 20:58:19.934872 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 27/54] 10.222.0.39 () {64 vars in 1235 bytes} [Wed Jul 13 20:58:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 20:58:20.882543 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-075fa0df-e439-4301-8fe9-7563b3d61870 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:58:20.883580 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-075fa0df-e439-4301-8fe9-7563b3d61870 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jul 13 20:58:20.884000 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 28/55] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Jul 13 20:58:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 20:58:21.396961 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-ef086dfe-e18e-4f2a-9641-664bbd82af73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 20:58:21.413767 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-ef086dfe-e18e-4f2a-9641-664bbd82af73 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.395016 Jul 13 20:58:21.414302 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 28/56] 10.222.0.39 () {64 vars in 1235 bytes} [Wed Jul 13 20:58:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 20:58:22.371825 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-075fa0df-e439-4301-8fe9-7563b3d61870 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:58:22.372837 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-075fa0df-e439-4301-8fe9-7563b3d61870 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Jul 13 20:58:22.373261 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 29/57] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Jul 13 20:58:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 20:58:22.886874 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-8b7ece73-6694-46f9-995b-84ce988ecf66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 20:58:22.904466 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-8b7ece73-6694-46f9-995b-84ce988ecf66 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.394268 Jul 13 20:58:22.904999 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 29/58] 10.222.0.39 () {64 vars in 1235 bytes} [Wed Jul 13 20:58:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 20:58:23.862631 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-075fa0df-e439-4301-8fe9-7563b3d61870 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:58:23.863671 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-075fa0df-e439-4301-8fe9-7563b3d61870 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jul 13 20:58:23.864056 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 30/59] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Jul 13 20:58:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 20:58:24.387586 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-a6dfd79b-122a-4508-9792-1eb1164f6050 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 20:58:24.405926 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-a6dfd79b-122a-4508-9792-1eb1164f6050 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.406549 Jul 13 20:58:24.406456 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 30/60] 10.222.0.39 () {64 vars in 1235 bytes} [Wed Jul 13 20:58:23 2022] POST /compute/v2.1/flavors => generated 409 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 20:58:25.364177 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-075fa0df-e439-4301-8fe9-7563b3d61870 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:58:25.365171 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-075fa0df-e439-4301-8fe9-7563b3d61870 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jul 13 20:58:25.365552 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 31/61] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Jul 13 20:58:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 20:58:25.877055 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-9c3037d0-b6d8-411d-abd1-4de9738595bc admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:58:25.896294 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-9c3037d0-b6d8-411d-abd1-4de9738595bc admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.396312 Jul 13 20:58:25.896816 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 31/62] 10.222.0.39 () {60 vars in 1202 bytes} [Wed Jul 13 20:58:25 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 20:59:17.764347 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-075fa0df-e439-4301-8fe9-7563b3d61870 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:59:17.765358 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-075fa0df-e439-4301-8fe9-7563b3d61870 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jul 13 20:59:17.765749 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 32/63] 10.222.0.39 () {54 vars in 930 bytes} [Wed Jul 13 20:59:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 20:59:17.776608 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:59:18.148196 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-985020ba-b8cc-4aec-a9d1-d1d0def80e6f admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:59:18.167539 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-985020ba-b8cc-4aec-a9d1-d1d0def80e6f admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.395785 Jul 13 20:59:18.168057 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 32/64] 10.222.0.39 () {60 vars in 1291 bytes} [Wed Jul 13 20:59:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 20:59:18.190757 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-f0099cd2-93e9-4907-9dbb-5d7510d9222f admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:59:18.194105 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG dbcounter [-] [103949] Writing DB stats nova_api:SELECT=14 {{(pid=103949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:59:18.199886 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-f0099cd2-93e9-4907-9dbb-5d7510d9222f admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012753 Jul 13 20:59:18.200401 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 33/65] 10.222.0.39 () {60 vars in 1282 bytes} [Wed Jul 13 20:59:18 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 20:59:18.211706 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-86608688-af4e-4938-aa14-11103244c502 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:59:18.219815 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-86608688-af4e-4938-aa14-11103244c502 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011661 Jul 13 20:59:18.220316 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 33/66] 10.222.0.39 () {60 vars in 1285 bytes} [Wed Jul 13 20:59:18 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 20:59:18.231395 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-e9bd66f6-7380-4b48-b8c9-8e6c1d728a8f admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:59:18.238956 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-e9bd66f6-7380-4b48-b8c9-8e6c1d728a8f admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011243 Jul 13 20:59:18.239456 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 34/67] 10.222.0.39 () {60 vars in 1285 bytes} [Wed Jul 13 20:59:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 20:59:18.250355 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-85b85d2b-e1d8-4784-9859-742c633b866e admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 20:59:18.257633 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-85b85d2b-e1d8-4784-9859-742c633b866e admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010864 Jul 13 20:59:18.258128 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 34/68] 10.222.0.39 () {60 vars in 1282 bytes} [Wed Jul 13 20:59:18 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:02:31.646827 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-e9bd66f6-7380-4b48-b8c9-8e6c1d728a8f admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:02:31.647842 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-e9bd66f6-7380-4b48-b8c9-8e6c1d728a8f admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 13 21:02:31.648264 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 35/69] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Jul 13 21:02:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:02:31.786738 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_api:SELECT=6 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:02:31.942972 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-be20f3f3-e647-483f-9545-aac80ce2789f admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:02:31.944127 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 21:02:31.944127 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: warnings.warn(msg) Jul 13 21:02:31.945312 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-be20f3f3-e647-483f-9545-aac80ce2789f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:02:31.945745 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-be20f3f3-e647-483f-9545-aac80ce2789f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:02:31.946516 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-be20f3f3-e647-483f-9545-aac80ce2789f admin admin] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:02:31.946964 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-be20f3f3-e647-483f-9545-aac80ce2789f admin admin] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:02:31.980484 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-be20f3f3-e647-483f-9545-aac80ce2789f admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.195169 Jul 13 21:02:31.981031 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 35/70] 10.222.0.39 () {60 vars in 1193 bytes} [Wed Jul 13 21:02:31 2022] GET /compute/v2.1/os-services => generated 794 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 21:02:32.803972 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-e9bd66f6-7380-4b48-b8c9-8e6c1d728a8f admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:02:32.805005 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-e9bd66f6-7380-4b48-b8c9-8e6c1d728a8f admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jul 13 21:02:32.805396 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 36/71] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Jul 13 21:02:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:02:32.993654 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-382d2a58-2ff0-4aff-a96b-58fcdcdef8c5 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:02:32.994863 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 21:02:32.994863 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: warnings.warn(msg) Jul 13 21:02:32.996071 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-382d2a58-2ff0-4aff-a96b-58fcdcdef8c5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:02:32.996521 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-382d2a58-2ff0-4aff-a96b-58fcdcdef8c5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:02:32.997357 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-382d2a58-2ff0-4aff-a96b-58fcdcdef8c5 admin admin] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:02:32.997780 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-382d2a58-2ff0-4aff-a96b-58fcdcdef8c5 admin admin] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:02:33.017435 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-382d2a58-2ff0-4aff-a96b-58fcdcdef8c5 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.075032 Jul 13 21:02:33.017925 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 36/72] 10.222.0.39 () {60 vars in 1193 bytes} [Wed Jul 13 21:02:32 2022] GET /compute/v2.1/os-services => generated 794 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 21:02:44.266338 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-e9bd66f6-7380-4b48-b8c9-8e6c1d728a8f admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:02:44.267381 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-e9bd66f6-7380-4b48-b8c9-8e6c1d728a8f admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 13 21:02:44.267775 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 37/73] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Jul 13 21:02:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:02:44.412636 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_cell0:SELECT=4 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:02:44.413338 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_cell1:SELECT=4 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:02:44.413984 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_api:SELECT=8 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:02:44.462179 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-609cb821-d7bd-4cca-bb2a-8b0690d9e073 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:02:44.463415 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 21:02:44.463415 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: warnings.warn(msg) Jul 13 21:02:44.464676 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-609cb821-d7bd-4cca-bb2a-8b0690d9e073 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:02:44.465120 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-609cb821-d7bd-4cca-bb2a-8b0690d9e073 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:02:44.465913 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-609cb821-d7bd-4cca-bb2a-8b0690d9e073 admin admin] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:02:44.466343 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-609cb821-d7bd-4cca-bb2a-8b0690d9e073 admin admin] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:02:44.491470 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-609cb821-d7bd-4cca-bb2a-8b0690d9e073 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.083188 Jul 13 21:02:44.491946 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 37/74] 10.222.0.39 () {60 vars in 1193 bytes} [Wed Jul 13 21:02:44 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:02:45.310514 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-e9bd66f6-7380-4b48-b8c9-8e6c1d728a8f admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:02:45.311556 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-e9bd66f6-7380-4b48-b8c9-8e6c1d728a8f admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 13 21:02:45.311974 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 38/75] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Jul 13 21:02:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:02:45.500633 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-48609be5-d78d-4943-8490-37c6f814c94a admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:02:45.501808 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 21:02:45.501808 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: warnings.warn(msg) Jul 13 21:02:45.503061 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-48609be5-d78d-4943-8490-37c6f814c94a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:02:45.503504 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-48609be5-d78d-4943-8490-37c6f814c94a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:02:45.504362 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-48609be5-d78d-4943-8490-37c6f814c94a admin admin] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:02:45.504824 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-48609be5-d78d-4943-8490-37c6f814c94a admin admin] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:02:45.526203 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-48609be5-d78d-4943-8490-37c6f814c94a admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.076552 Jul 13 21:02:45.526708 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 38/76] 10.222.0.39 () {60 vars in 1193 bytes} [Wed Jul 13 21:02:45 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:03:42.198069 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: Wed Jul 13 21:03:42 2022 - graceful shutdown triggered... Jul 13 21:03:42.198549 dv-cinder-799871-27-iscsi devstack@n-api.service[103949]: Gracefully killing worker 1 (pid: 103949)... Jul 13 21:03:42.198194 dv-cinder-799871-27-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 13 21:03:42.199391 dv-cinder-799871-27-iscsi devstack@n-api.service[103950]: Gracefully killing worker 2 (pid: 103950)... Jul 13 21:03:43.199001 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: worker 1 buried after 1 seconds Jul 13 21:03:43.199001 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: worker 2 buried after 1 seconds Jul 13 21:03:43.199001 dv-cinder-799871-27-iscsi devstack@n-api.service[103948]: goodbye to uWSGI. Jul 13 21:03:43.200521 dv-cinder-799871-27-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 13 21:03:43.201080 dv-cinder-799871-27-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 13 21:03:43.203877 dv-cinder-799871-27-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 13 21:03:43.213125 dv-cinder-799871-27-iscsi devstack@n-api.service[118423]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 13 21:03:43.215845 dv-cinder-799871-27-iscsi devstack@n-api.service[118423]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 13 21:03:43 2022] *** Jul 13 21:03:43.216004 dv-cinder-799871-27-iscsi devstack@n-api.service[118423]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 13 21:03:43.216133 dv-cinder-799871-27-iscsi devstack@n-api.service[118423]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 13 21:03:43.216253 dv-cinder-799871-27-iscsi devstack@n-api.service[118423]: nodename: dv-cinder-799871-27-iscsi Jul 13 21:03:43.216365 dv-cinder-799871-27-iscsi devstack@n-api.service[118423]: machine: x86_64 Jul 13 21:03:43.216480 dv-cinder-799871-27-iscsi devstack@n-api.service[118423]: clock source: unix Jul 13 21:03:43.216595 dv-cinder-799871-27-iscsi devstack@n-api.service[118423]: pcre jit disabled Jul 13 21:03:43.216703 dv-cinder-799871-27-iscsi devstack@n-api.service[118423]: detected number of CPU cores: 4 Jul 13 21:03:43.216826 dv-cinder-799871-27-iscsi devstack@n-api.service[118423]: current working directory: / Jul 13 21:03:43.216826 dv-cinder-799871-27-iscsi devstack@n-api.service[118423]: detected binary path: /usr/bin/uwsgi-core Jul 13 21:03:43.216826 dv-cinder-799871-27-iscsi devstack@n-api.service[118423]: your processes number limit is 47680 Jul 13 21:03:43.216826 dv-cinder-799871-27-iscsi devstack@n-api.service[118423]: your memory page size is 4096 bytes Jul 13 21:03:43.216826 dv-cinder-799871-27-iscsi devstack@n-api.service[118423]: detected max file descriptor number: 2048 Jul 13 21:03:43.216826 dv-cinder-799871-27-iscsi devstack@n-api.service[118423]: lock engine: pthread robust mutexes Jul 13 21:03:43.217265 dv-cinder-799871-27-iscsi devstack@n-api.service[118423]: thunder lock: enabled Jul 13 21:03:43.217265 dv-cinder-799871-27-iscsi devstack@n-api.service[118423]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 13 21:03:43.217265 dv-cinder-799871-27-iscsi devstack@n-api.service[118423]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 13 21:03:43.261949 dv-cinder-799871-27-iscsi devstack@n-api.service[118423]: Python main interpreter initialized at 0x556235a369c0 Jul 13 21:03:43.261949 dv-cinder-799871-27-iscsi devstack@n-api.service[118423]: python threads support enabled Jul 13 21:03:43.261949 dv-cinder-799871-27-iscsi devstack@n-api.service[118423]: your server socket listen backlog is limited to 100 connections Jul 13 21:03:43.261949 dv-cinder-799871-27-iscsi devstack@n-api.service[118423]: your mercy for graceful operations on workers is 90 seconds Jul 13 21:03:43.262420 dv-cinder-799871-27-iscsi devstack@n-api.service[118423]: mapped 403077 bytes (393 KB) for 2 cores Jul 13 21:03:43.262420 dv-cinder-799871-27-iscsi devstack@n-api.service[118423]: *** Operational MODE: preforking *** Jul 13 21:03:43.262703 dv-cinder-799871-27-iscsi devstack@n-api.service[118423]: *** uWSGI is running in multiple interpreter mode *** Jul 13 21:03:43.262703 dv-cinder-799871-27-iscsi devstack@n-api.service[118423]: spawned uWSGI master process (pid: 118423) Jul 13 21:03:43.262909 dv-cinder-799871-27-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 13 21:03:43.263457 dv-cinder-799871-27-iscsi devstack@n-api.service[118423]: spawned uWSGI worker 1 (pid: 118444, cores: 1) Jul 13 21:03:43.263986 dv-cinder-799871-27-iscsi devstack@n-api.service[118423]: spawned uWSGI worker 2 (pid: 118445, cores: 1) Jul 13 21:03:43.264378 dv-cinder-799871-27-iscsi devstack@n-api.service[118423]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 13 21:03:43.923023 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 13 21:03:43.926844 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 13 21:03:45.129452 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 21:03:45.129452 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: from cryptography.utils import int_from_bytes Jul 13 21:03:45.130076 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 21:03:45.130076 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: from cryptography.utils import int_from_bytes Jul 13 21:03:45.130076 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 21:03:45.130076 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: from cryptography.utils import int_from_bytes Jul 13 21:03:45.130610 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 21:03:45.130610 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: from cryptography.utils import int_from_bytes Jul 13 21:03:47.460718 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 13 21:03:47.461363 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 13 21:03:47.461624 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 13 21:03:47.461909 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 13 21:03:47.462010 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 13 21:03:47.462362 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 13 21:03:47.462465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 13 21:03:47.462568 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.462791 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 13 21:03:47.462898 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.463143 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 13 21:03:47.463245 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.463404 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 13 21:03:47.463576 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.463793 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.463901 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.464186 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.464296 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.464455 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.464558 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.464762 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.464859 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.465087 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.465194 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.465375 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.465472 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.465697 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.465806 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.466015 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.466125 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-27-iscsi {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.466339 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.466439 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.466602 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.466785 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.466957 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.467120 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.467284 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-27-iscsi {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.467439 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.467587 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.467738 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.467890 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.468043 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.468184 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.468327 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.468510 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.468697 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.468949 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.469131 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.469449 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.469620 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.469771 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.469930 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.470175 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.470362 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.470518 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.470717 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.470880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.471034 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.471184 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.471336 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.471486 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.471635 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.471794 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.471949 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.472102 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.472242 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.472390 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.472541 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.473004 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.473197 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-27-iscsi {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.473352 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.473499 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.473647 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-27-iscsi {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.473804 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.473967 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.474122 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.474270 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.474422 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.474575 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.474850 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.475016 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.475161 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.475301 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.475450 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.475605 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.475774 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.475930 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.476084 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.476226 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.476374 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.476530 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.476674 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.477501 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.477659 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.477809 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.477963 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.478121 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.478271 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.478412 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.478571 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.478766 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.478931 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.479080 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.479223 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.479375 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.479681 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.479838 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.479991 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.480144 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.480297 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.480446 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.480595 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.480747 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.480918 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.481061 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.481203 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.481343 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.481484 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.481628 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.481779 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.481931 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.482076 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.482219 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.482380 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.482536 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.482740 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.482917 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.483231 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.483387 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.483545 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.483694 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.483835 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.484116 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.484318 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.484687 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.484853 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.484967 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.485077 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.485184 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.485301 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.485410 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.485527 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.485647 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.485757 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.485864 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.485972 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.486097 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.486213 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.486322 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.486430 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.486544 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.487042 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.487213 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.487213 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.487723 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.487723 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.488008 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.488152 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.488303 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.488303 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.488583 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.488583 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.488876 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.489025 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.489179 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.489179 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.489464 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.489754 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.489907 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.489907 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.490198 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.490341 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.490488 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.490488 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.490909 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.491104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.491257 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.491401 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.491542 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.491690 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.491902 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.491902 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.492183 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.492387 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.493119 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.493539 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.493704 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.493863 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.494006 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.494154 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.494302 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.494452 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.494594 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.494789 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.494941 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.495095 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.495236 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.495387 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.495539 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.495698 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.495850 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.495992 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.496140 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.496288 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.496440 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.496590 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.496738 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.496880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.497020 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.497160 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.497309 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.497451 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.497824 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.497976 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.498125 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.498268 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.498419 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.498560 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.498733 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.498886 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.499034 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.499256 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.499406 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.499559 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.499846 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.500024 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.500167 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.500317 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.500467 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.500608 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.500750 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.500890 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.501031 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.501180 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.501330 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.501479 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.501619 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.501778 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.501920 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.502078 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.502227 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.502376 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.502526 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.502713 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.502898 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.503053 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.503202 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.503352 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.503677 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.503842 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.503997 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.504153 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.504303 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.504446 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.504594 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.504736 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.504888 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.505044 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.505185 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.505341 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.505490 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.505638 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.505788 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.505949 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.506090 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.506238 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.506379 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.506519 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.506695 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.506843 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.506990 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.507141 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.507282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.507422 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.507576 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.507866 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.508131 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.508280 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.508422 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.508563 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.508714 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.508856 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.508998 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.509140 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.509287 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:03:47.509438 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.509604 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.509755 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.510062 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.510226 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.510379 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.510542 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.510773 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.510932 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.511087 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.511238 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.511391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.511548 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.511704 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.511852 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.511999 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.512167 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.512326 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.512475 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.512803 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.512984 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.513155 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.513305 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.513470 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.513629 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.513963 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.514121 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.514267 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.514448 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.514607 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.514797 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.514953 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.515113 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.515260 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.515415 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.515570 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.515734 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.515888 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.516044 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.516191 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.516338 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.516505 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.516663 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.516811 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.516957 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.517111 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.517259 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.517415 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.517564 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.517718 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.518016 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.518264 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.518421 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.518579 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.518799 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.518958 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.519107 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.519253 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.519400 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.519567 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.519725 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.519880 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.520172 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.520336 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.520492 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.520654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.520826 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.520974 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.521121 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.521268 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.521424 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.521579 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.521736 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.521884 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.522039 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.522186 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.522343 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.522490 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.522664 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.522830 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.522988 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.523145 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.523307 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.523462 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.523664 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.523821 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.524155 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.524319 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.524482 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.524638 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.524797 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.524953 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.525120 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.525274 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.525435 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.525589 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.525748 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.525897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.526053 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.526280 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.526467 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.526975 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.527146 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.527297 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.527444 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.527617 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.527767 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.528045 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.528213 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.528451 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.528605 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.528770 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.528919 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.529076 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.529242 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.529390 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.529555 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.529713 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.529880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.530038 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.530329 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.530491 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.530688 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.530843 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.531082 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.531246 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.531396 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.531542 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.531704 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.531851 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.532018 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.532165 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.532320 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.532468 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.532624 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.532771 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.532917 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.533063 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.533210 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.533356 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.533512 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.533667 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.533822 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.533978 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.534308 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.534480 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.534650 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.534816 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.534974 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.535135 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.535283 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.535445 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.535593 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.535740 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.535895 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.536050 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.536217 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.536378 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.536534 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.536689 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.536843 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.536990 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.537145 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.537301 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.537450 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.537596 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.537744 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.537897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.538207 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.538364 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.538603 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.538873 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.539024 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.539673 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.539847 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.540002 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.540161 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.540450 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.540619 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.540776 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.540941 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.541108 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.541264 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.541418 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.541574 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.541729 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.541891 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.542165 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.542334 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.542493 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.542702 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.542875 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.543025 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.543172 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.543342 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.543498 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.543652 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.543815 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.543971 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.544125 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.544453 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.544621 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.544621 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.544934 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.544934 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.545215 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.545215 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.545526 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.545681 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.545838 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.545994 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.546142 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.546295 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.546453 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.546632 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.546798 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.546956 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.547104 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.547251 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.547399 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.547574 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.547722 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.547875 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.548031 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.548324 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.548491 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.548746 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.548908 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.549067 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.549215 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.549369 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.549534 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.549778 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.549949 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.550102 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.550250 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.550552 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.550778 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.550940 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.551098 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.551253 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.551401 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.551548 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.551704 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.551851 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.552009 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.552167 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.552315 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.552461 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.552622 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.552776 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.552949 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.553329 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.553486 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.553641 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.553799 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.553947 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.554102 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.554269 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.554444 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.554709 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.555557 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.555717 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.555914 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.556068 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.556217 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.556374 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.556531 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.556685 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.556834 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.556981 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.557141 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.557298 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.557447 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.557601 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.557750 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.557896 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.558042 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.558198 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.558576 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.558855 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.559013 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.559171 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.559336 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.559578 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.559738 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.559893 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.560089 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.560287 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.560446 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.560752 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.560909 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.561641 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.561875 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.562050 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.562243 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.562406 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.562565 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.562739 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.562900 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.563047 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.563254 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.563407 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.563554 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.563708 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.563855 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.564002 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.564159 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.564306 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.564471 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.564626 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.564887 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.565076 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.565319 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.565483 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.565631 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.565786 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.565941 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.566098 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.566247 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.566401 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.566562 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.566775 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.566927 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.567087 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.567235 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.567382 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.567537 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.567684 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.567839 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.567997 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.568144 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.568290 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.568443 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.568753 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.569022 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.569188 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.569338 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.569485 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.569633 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.569787 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.569953 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.570105 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.570259 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.570414 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.570804 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.571032 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.571203 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.571370 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.571526 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.571674 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.571828 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.571984 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.572143 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.572299 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.572454 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.572608 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.572756 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.572902 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.573063 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.573223 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.573371 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.573518 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.573665 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.573821 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.573976 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.574131 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.574131 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.574421 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.574567 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.574831 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.575081 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.575244 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.575505 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.575663 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.575811 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.575968 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.576117 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.576289 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.576457 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.576607 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.576769 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.576918 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.577065 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.577212 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.577361 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.577527 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.577690 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.577847 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.577995 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.578143 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.578297 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.578447 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.578603 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.578974 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.579221 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.579377 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.579535 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.579684 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.579854 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.580022 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.580185 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.580342 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.580491 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.580647 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.580819 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.581067 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.581301 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.581456 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.581615 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.581779 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.581953 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.582109 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.582258 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.582406 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.582554 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.582729 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.582896 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.583054 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.583209 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.583358 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.583506 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.583654 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.583852 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.584013 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.584167 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.584324 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.584471 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.584619 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.584776 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.584924 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.585095 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.585338 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.585510 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.585762 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.585927 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.586107 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.586272 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.586428 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.586576 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.586775 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.586933 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.587090 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.587246 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.587395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.587542 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.587704 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.587861 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.588016 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.588164 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.588322 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.588469 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.588630 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.588778 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.589081 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.589252 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.589484 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.589648 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.589805 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.589965 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.590115 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.590274 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.590434 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.590596 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.590781 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.590941 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.591184 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.591420 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.591584 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.591815 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.591975 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.592123 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.592270 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.592431 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.592588 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.592760 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.592908 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.593056 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.593210 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.593409 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.593578 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.593727 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.593875 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.594030 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.594187 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.594335 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.594495 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.594672 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.594847 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.594995 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.595151 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.595298 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.595555 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.595710 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.595959 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.596112 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.596261 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.596408 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.596567 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.596715 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.596879 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.597027 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.597182 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.597339 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.597494 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.597641 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.597797 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.597959 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.598108 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.598270 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.598418 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.598572 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.598744 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.598915 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.599212 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.599455 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.599682 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.599855 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.600009 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.600221 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.600373 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.600529 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.600686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.600834 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.600981 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.601128 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.601401 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.601630 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.602295 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.602455 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.602669 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.602829 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.602995 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.603156 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.603305 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.603460 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.603616 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.603764 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.603921 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.604087 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.604235 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.604382 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.604536 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.604683 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.604845 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.604941 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.605014 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.605090 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.605161 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.605240 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.605325 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.605415 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.605415 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.605583 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.605674 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.605768 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.605852 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.606096 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.606211 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.606297 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.606387 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.606486 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.606579 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.606691 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.606777 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.606868 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.606960 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.607057 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.607141 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.607231 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.607322 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.607406 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.607498 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.607582 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.607665 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.607755 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.607845 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.607929 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.607929 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.608107 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.608107 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.608268 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.608268 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.608416 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.608416 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.608591 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.608682 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.608766 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.608855 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.608939 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.609030 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.609259 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.609356 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.609440 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.609531 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.609630 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.609730 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.609821 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.609904 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.609986 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.610075 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.610171 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.610262 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.610356 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.610446 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.610529 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.610610 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.610865 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.610947 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.611018 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.611107 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.611196 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.611279 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.611390 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.611476 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.611558 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.611798 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.611895 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.611987 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.612084 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.612169 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.612251 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.612333 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.612424 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.612516 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.612608 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.612700 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.612700 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.612700 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.612700 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.612700 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.613084 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.613170 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.613170 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.613170 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.613170 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.613170 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.613170 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.613170 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.613170 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.613757 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.613757 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.613927 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.614011 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.614011 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.614011 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.614011 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.614011 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.614361 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.614440 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.614440 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.614440 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.614440 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.614727 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.614801 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.614801 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.614801 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.614801 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.614801 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.614801 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.614801 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.614801 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.615313 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.615383 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.615460 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.615540 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.615611 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.615687 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.615758 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.615826 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.615904 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.615975 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.616263 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.616368 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.616473 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.616555 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.616800 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.616880 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.617119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.617199 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.620258 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.621288 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.621288 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.621455 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.621455 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.621455 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.621455 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.621455 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.622200 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.622295 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.622391 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.622521 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.622634 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.622772 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.622772 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.622983 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.623076 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.623076 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.624722 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.624870 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.624870 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.624870 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.625229 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.625370 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.625370 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.625617 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.625711 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.625796 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.625878 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.625878 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.626079 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.626170 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.626170 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.626170 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.626658 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.626746 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.626746 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.626746 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.627012 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.627173 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.627173 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.627408 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.627622 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.629053 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.629202 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.629341 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.629521 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.629742 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.629866 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.629984 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.629984 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.630497 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.630714 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.630868 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.631029 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.631029 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.631464 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.631609 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.631741 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.631894 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.633239 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.633467 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.633617 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.633989 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.633989 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.634364 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.634493 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.634647 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.635128 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.635281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.635420 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.635559 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.635688 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.635831 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.635961 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.636097 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.636239 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.636635 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.636778 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.636778 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.636778 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.637161 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.637609 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.637744 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.637872 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.638014 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.638145 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.638145 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.638145 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.638517 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.638725 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.638865 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.639000 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.639136 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.639265 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.639393 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.639533 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.639533 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.639792 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.639927 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.639927 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.640176 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.640314 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.640314 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.640711 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.640844 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.640972 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.641098 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.641098 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.641365 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.641585 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.641585 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.641847 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.641995 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.641995 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.642364 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.642519 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.642730 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.642874 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.642874 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.643134 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.643268 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.643268 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.643519 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.643652 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.643795 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.643923 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.643923 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.644172 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.644308 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.644308 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.644560 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.644694 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.644821 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.645058 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.645196 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.645430 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.645660 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.645791 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.646060 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.646196 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.646384 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.646565 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.646735 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.647032 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.647163 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.647347 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.647694 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.647853 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.647983 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.648109 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.648265 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.648396 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.649092 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.649343 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.649477 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.649720 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.649950 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.650182 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.650321 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.650636 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.650969 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.651268 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.651409 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.651877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.652027 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.652155 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.653012 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.653172 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.653172 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.653435 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.653577 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.653713 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.653849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.653986 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.654113 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.654113 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.654376 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.654511 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.654667 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.654876 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.655008 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.655267 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.655398 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.655586 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.655810 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.655942 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.656206 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.656350 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.657012 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.657160 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.657289 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.657425 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.657554 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.657554 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.657928 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.658155 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.658554 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.658750 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.658750 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.659004 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.659141 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.659329 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.659474 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.659474 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.659751 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.659891 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.660030 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.660160 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.660324 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.660463 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.660638 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.660951 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.661108 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.661238 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.661371 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.661599 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.661736 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.662052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.662205 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.662343 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.662564 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.662739 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.663140 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.663301 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.663431 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.663565 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.663745 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.663982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.664120 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.664974 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.665236 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.665368 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.665556 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.665762 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.665894 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.666182 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.666313 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.666490 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.666684 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.666844 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.667105 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.667254 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.667452 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.667583 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.667777 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.668017 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.668184 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.668401 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.668532 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.668691 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.668894 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.669025 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.669317 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.669528 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.669740 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.669872 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.670175 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.670326 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.670659 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.671015 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.671421 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.671905 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.672044 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.672265 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.672415 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.672546 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.672772 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.672913 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.673044 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.673201 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.673413 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.673552 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.673689 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.673819 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.673947 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.674088 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.674224 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.674360 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.674489 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.674679 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.674812 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.674955 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.675086 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.675212 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.675347 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.675482 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.675617 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.675759 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.675890 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.676017 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.676205 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.676336 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.676522 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.676660 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.676838 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.676977 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.677158 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.677296 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.677474 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.677605 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.677784 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.677916 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.678152 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.678300 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.678461 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.678691 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.678835 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.678965 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.679093 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.679290 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.679432 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.679609 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.679740 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.679948 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.680090 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.680257 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.680390 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.680571 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.680703 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.680878 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.681011 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.681292 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.681428 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.681716 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.681849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.681978 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.682105 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.682260 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.682456 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.682587 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.682794 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.682990 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.683202 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.683337 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.683550 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.683684 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.683813 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.683948 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.684087 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.684216 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.684344 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.684472 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.684599 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.684735 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.684873 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.685010 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.685146 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.685283 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.685460 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.685603 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.685784 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.685918 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.686113 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.686253 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.686428 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.686572 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.686769 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.686912 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.687080 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.687210 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.687384 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.687525 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.687697 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.687834 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.688012 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.688149 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.688379 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.688512 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.688663 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.688869 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.689011 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.689146 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.689283 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.689412 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.689538 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.689666 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.689813 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.689951 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.690124 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.690263 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.690435 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.690574 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.690793 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.690936 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.691066 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.691321 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.691463 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.691619 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.691750 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.691931 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.692064 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.692262 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.692395 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.692604 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.692736 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.692899 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.693116 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.693256 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.693384 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.693575 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.693776 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.693917 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.694055 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.694183 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.694319 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.694455 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.694597 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.694769 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.694906 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.695057 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.695218 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.695350 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.695708 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.696022 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.696310 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.696471 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.696615 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.696763 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.696920 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.697072 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.697392 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.697549 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.697699 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.697874 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.698017 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.698167 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.698354 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.698595 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.698815 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.699071 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.699221 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.699372 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.699372 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.699648 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.699798 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.699949 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.700104 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.700245 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.700386 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.700534 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.700676 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.700825 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.700967 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.701115 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.701254 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.701539 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.701701 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.701845 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.701982 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.702113 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.702288 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.702418 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.702675 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.702830 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.702976 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.703128 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.703334 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.703466 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.703608 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.703751 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.703952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.704092 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.704223 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.704365 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.704501 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.704627 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.704761 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.704890 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.705018 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.705164 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.705302 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.705420 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.705548 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.705708 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.705841 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.706015 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.706147 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.706328 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.706460 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.706707 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.706857 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.707002 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.707140 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.707272 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.707401 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.707559 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.707698 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.707865 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.707999 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.708171 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.708313 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.708483 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.708641 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.708856 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.708996 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.709222 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.709363 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.709493 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.709630 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.709758 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.709886 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.710020 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.710157 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.710292 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.710435 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.710606 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.710764 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.710948 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.711704 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.711849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.712082 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.712276 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.712462 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.712595 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.712794 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.712996 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.713133 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.713281 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.713498 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.713632 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.713771 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.713927 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.714127 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.714260 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.714389 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.714522 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.714692 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.714831 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.715002 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.715141 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.715337 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.715466 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.715651 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.715778 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.715964 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.716096 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.716276 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.716408 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.716587 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.716727 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.716897 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.717035 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.717206 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.717344 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.717515 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.717647 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.717873 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.718002 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.718198 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.718398 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.718530 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.718744 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.718902 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.719121 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.719267 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.719489 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.719628 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.719765 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.719902 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.720066 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.720205 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.720380 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.720513 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.720695 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.720827 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.721015 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.721161 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.721329 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.721462 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.721643 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.721910 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.722038 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.722179 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.722309 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.722444 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.722574 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.722730 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.722882 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.723090 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.723225 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.723360 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.723504 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.723697 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.723842 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.723979 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.724190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.724344 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.724502 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.724643 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.724822 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.724945 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.725132 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.725278 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.725454 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.725592 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.725772 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.725903 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.726081 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.726212 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.726339 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 13 21:03:47.726467 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.726773 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.727595 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.727941 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.728273 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.728600 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.728909 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.729223 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.729531 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.729865 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.730188 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.730500 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.730832 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.731136 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.731448 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.731755 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.732058 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.732364 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.732669 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.732977 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.733279 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.733582 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.733886 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.734189 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.734493 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.734827 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.735134 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.735437 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.735741 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.736050 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.736357 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.736662 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.737006 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.737343 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.737660 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.737982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.738297 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.738669 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.738987 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.739370 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.739730 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.739957 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.740266 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.740604 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.740918 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.741232 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.741544 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.741856 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.742228 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.742540 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.742904 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.743240 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.743547 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.743877 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.744194 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.744519 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.744837 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.745149 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.745481 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.745792 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.746106 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.746421 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.746754 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.747068 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.747384 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.747694 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.748008 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.748324 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.748638 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.748968 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.749297 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.749608 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.749934 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.750261 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.750646 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.750948 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.751292 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.751621 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.751934 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.752246 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.752551 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:03:47.752794 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 13 21:03:47.878561 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO dbcounter [None req-1c2ff128-06f4-4673-9edc-9dea068e478f None None] Registered counter for database nova_api Jul 13 21:03:47.898298 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_db.sqlalchemy.engines [None req-1c2ff128-06f4-4673-9edc-9dea068e478f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118445) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 21:03:47.904080 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO dbcounter [None req-077eda17-bed8-4f05-9a20-2059db6677bd None None] Registered counter for database nova_api Jul 13 21:03:47.905647 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writer thread running {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 21:03:47.923971 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_db.sqlalchemy.engines [None req-077eda17-bed8-4f05-9a20-2059db6677bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118444) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 21:03:47.930501 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writer thread running {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 21:03:47.961835 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.context [None req-1c2ff128-06f4-4673-9edc-9dea068e478f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7dc43128-f6a8-43a1-9bd0-df8b45860749(cell1) {{(pid=118445) load_cells /opt/stack/nova/nova/context.py:464}} Jul 13 21:03:47.965930 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1c2ff128-06f4-4673-9edc-9dea068e478f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:03:47.967537 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1c2ff128-06f4-4673-9edc-9dea068e478f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:03:47.968352 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1c2ff128-06f4-4673-9edc-9dea068e478f None None] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:03:47.970302 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1c2ff128-06f4-4673-9edc-9dea068e478f None None] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:03:47.972286 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO dbcounter [None req-1c2ff128-06f4-4673-9edc-9dea068e478f None None] Registered counter for database nova_cell0 Jul 13 21:03:47.976323 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO dbcounter [None req-1c2ff128-06f4-4673-9edc-9dea068e478f None None] Registered counter for database nova_cell1 Jul 13 21:03:47.983925 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_db.sqlalchemy.engines [None req-1c2ff128-06f4-4673-9edc-9dea068e478f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118445) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 21:03:47.986436 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_db.sqlalchemy.engines [None req-1c2ff128-06f4-4673-9edc-9dea068e478f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118445) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 21:03:47.987451 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.context [None req-077eda17-bed8-4f05-9a20-2059db6677bd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7dc43128-f6a8-43a1-9bd0-df8b45860749(cell1) {{(pid=118444) load_cells /opt/stack/nova/nova/context.py:464}} Jul 13 21:03:47.990633 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writer thread running {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 21:03:47.991562 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-077eda17-bed8-4f05-9a20-2059db6677bd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:03:47.993189 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-077eda17-bed8-4f05-9a20-2059db6677bd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:03:47.993749 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writer thread running {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 21:03:47.994002 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-077eda17-bed8-4f05-9a20-2059db6677bd None None] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:03:47.996008 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-077eda17-bed8-4f05-9a20-2059db6677bd None None] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:03:47.997959 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO dbcounter [None req-077eda17-bed8-4f05-9a20-2059db6677bd None None] Registered counter for database nova_cell0 Jul 13 21:03:48.001932 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO dbcounter [None req-077eda17-bed8-4f05-9a20-2059db6677bd None None] Registered counter for database nova_cell1 Jul 13 21:03:48.009472 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_db.sqlalchemy.engines [None req-077eda17-bed8-4f05-9a20-2059db6677bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118444) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 21:03:48.011726 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_db.sqlalchemy.engines [None req-077eda17-bed8-4f05-9a20-2059db6677bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118444) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 21:03:48.017270 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writer thread running {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 21:03:48.018628 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writer thread running {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 21:03:48.139065 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO dbcounter [None req-1c2ff128-06f4-4673-9edc-9dea068e478f None None] Registered counter for database nova_cell0 Jul 13 21:03:48.145911 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_db.sqlalchemy.engines [None req-1c2ff128-06f4-4673-9edc-9dea068e478f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118445) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 21:03:48.151243 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writer thread running {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 21:03:48.163149 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO dbcounter [None req-077eda17-bed8-4f05-9a20-2059db6677bd None None] Registered counter for database nova_cell0 Jul 13 21:03:48.172002 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_db.sqlalchemy.engines [None req-077eda17-bed8-4f05-9a20-2059db6677bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118444) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 21:03:48.176622 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writer thread running {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 21:03:48.472727 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: WARNING keystonemiddleware.auth_token [None req-1c2ff128-06f4-4673-9edc-9dea068e478f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 13 21:03:48.480046 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: WARNING keystonemiddleware.auth_token [None req-1c2ff128-06f4-4673-9edc-9dea068e478f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 13 21:03:48.497065 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: WARNING keystonemiddleware.auth_token [None req-077eda17-bed8-4f05-9a20-2059db6677bd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 13 21:03:48.504976 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: WARNING keystonemiddleware.auth_token [None req-077eda17-bed8-4f05-9a20-2059db6677bd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 13 21:03:48.833764 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: WARNING keystonemiddleware.auth_token [None req-1c2ff128-06f4-4673-9edc-9dea068e478f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 13 21:03:48.839766 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: WARNING keystonemiddleware.auth_token [None req-1c2ff128-06f4-4673-9edc-9dea068e478f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 13 21:03:48.846299 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556235a369c0 pid: 118445 (default app) Jul 13 21:03:48.853539 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: WARNING keystonemiddleware.auth_token [None req-077eda17-bed8-4f05-9a20-2059db6677bd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 13 21:03:48.859467 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: WARNING keystonemiddleware.auth_token [None req-077eda17-bed8-4f05-9a20-2059db6677bd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 13 21:03:48.865626 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556235a369c0 pid: 118444 (default app) Jul 13 21:04:29.421235 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_api:SELECT=3 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:04:29.422368 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=3 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:04:29.423324 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=3 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:04:29.424448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=3 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:04:29.580644 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_api:SELECT=3 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:04:29.581395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=3 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:04:29.583416 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell0:SELECT=3 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:04:29.584164 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell0:SELECT=3 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:04:30.939822 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-bc6d7168-117d-4813-8a9c-06997d4b36f4 tempest-VolumesGetTestJSON-1626588404 tempest-VolumesGetTestJSON-1626588404-project] Action: 'create', calling method: .version_select at 0x7f96ea6ecc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-436160106", "metadata": {"Type": "work"}}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:04:31.138707 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-558725d6-2839-4b3b-b979-1ee6a5a6cbe7 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Action: 'create', calling method: .version_select at 0x7f96ea6ecc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2030540300"}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:04:32.946203 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-bc6d7168-117d-4813-8a9c-06997d4b36f4 tempest-VolumesGetTestJSON-1626588404 tempest-VolumesGetTestJSON-1626588404-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.537728 Jul 13 21:04:32.947258 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 1/1] 10.222.0.39 () {60 vars in 1155 bytes} [Wed Jul 13 21:04:29 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3542 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 13 21:04:32.965372 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-fc472bb7-9b8b-40b4-aa34-79a34cdafcd8 tempest-VolumesGetTestJSON-1626588404 tempest-VolumesGetTestJSON-1626588404-project] Calling method '.version_select at 0x7f96ea5b6a60>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:33.639327 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-fc472bb7-9b8b-40b4-aa34-79a34cdafcd8 tempest-VolumesGetTestJSON-1626588404 tempest-VolumesGetTestJSON-1626588404-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/541eb19a-0589-409f-aaa2-da07fffcac25" status: 200 len: 352 microversion: 2.1 time: 0.683933 Jul 13 21:04:33.640644 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 2/2] 10.222.0.39 () {58 vars in 1244 bytes} [Wed Jul 13 21:04:32 2022] GET /compute/v2.1/os-volumes/541eb19a-0589-409f-aaa2-da07fffcac25 => generated 352 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:04:33.719331 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-558725d6-2839-4b3b-b979-1ee6a5a6cbe7 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.143757 Jul 13 21:04:33.729845 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 1/3] 10.222.0.39 () {60 vars in 1154 bytes} [Wed Jul 13 21:04:29 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4159 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 13 21:04:33.733091 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-6cc9999d-a763-4e3c-b57c-477cc240c031 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Calling method '.version_select at 0x7f96ea5b6d30>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:33.853871 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-6cc9999d-a763-4e3c-b57c-477cc240c031 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08" status: 200 len: 345 microversion: 2.1 time: 0.124580 Jul 13 21:04:33.854740 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 3/4] 10.222.0.39 () {58 vars in 1244 bytes} [Wed Jul 13 21:04:33 2022] GET /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08 => generated 345 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:04:34.654653 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-cc644f92-7cf7-4844-9ea6-907ae1108ce0 tempest-VolumesGetTestJSON-1626588404 tempest-VolumesGetTestJSON-1626588404-project] Calling method '.version_select at 0x7f96ea5b4a60>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:34.744627 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-cc644f92-7cf7-4844-9ea6-907ae1108ce0 tempest-VolumesGetTestJSON-1626588404 tempest-VolumesGetTestJSON-1626588404-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/541eb19a-0589-409f-aaa2-da07fffcac25" status: 200 len: 353 microversion: 2.1 time: 0.095470 Jul 13 21:04:34.747826 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 2/5] 10.222.0.39 () {58 vars in 1244 bytes} [Wed Jul 13 21:04:34 2022] GET /compute/v2.1/os-volumes/541eb19a-0589-409f-aaa2-da07fffcac25 => generated 353 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:04:34.761055 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-002cd12f-3ec2-4506-954c-5e7bb42e18bc tempest-VolumesGetTestJSON-1626588404 tempest-VolumesGetTestJSON-1626588404-project] Calling method '.version_select at 0x7f96ea5c9280>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:34.869210 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-1f82c0e9-ee22-4f42-a38c-716a0fd6c4d7 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Calling method '.version_select at 0x7f96ea5b4b80>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:35.094361 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-002cd12f-3ec2-4506-954c-5e7bb42e18bc tempest-VolumesGetTestJSON-1626588404 tempest-VolumesGetTestJSON-1626588404-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/541eb19a-0589-409f-aaa2-da07fffcac25" status: 200 len: 353 microversion: 2.1 time: 0.338596 Jul 13 21:04:35.097894 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 4/6] 10.222.0.39 () {58 vars in 1244 bytes} [Wed Jul 13 21:04:34 2022] GET /compute/v2.1/os-volumes/541eb19a-0589-409f-aaa2-da07fffcac25 => generated 353 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:04:35.126757 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-8ec1c0d0-e255-42b9-8ea6-848d593767de tempest-VolumesGetTestJSON-1626588404 tempest-VolumesGetTestJSON-1626588404-project] Calling method '.version_select at 0x7f96ea5c9940>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:35.174380 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-1f82c0e9-ee22-4f42-a38c-716a0fd6c4d7 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08" status: 200 len: 346 microversion: 2.1 time: 0.310956 Jul 13 21:04:35.175119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 3/7] 10.222.0.39 () {58 vars in 1244 bytes} [Wed Jul 13 21:04:34 2022] GET /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08 => generated 346 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:04:35.190004 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-4c73835c-3aa9-4c6e-9c7d-3968a5598fad tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Action: 'create', calling method: .version_select at 0x7f96ea5d01f0>, body: {"snapshot": {"volume_id": "0df7fa6f-6848-4c80-bd76-75ca86524d08", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1660041291"}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:04:35.436495 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-8ec1c0d0-e255-42b9-8ea6-848d593767de tempest-VolumesGetTestJSON-1626588404 tempest-VolumesGetTestJSON-1626588404-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/541eb19a-0589-409f-aaa2-da07fffcac25" status: 202 len: 0 microversion: 2.1 time: 0.320752 Jul 13 21:04:35.439947 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 5/8] 10.222.0.39 () {58 vars in 1247 bytes} [Wed Jul 13 21:04:35 2022] DELETE /compute/v2.1/os-volumes/541eb19a-0589-409f-aaa2-da07fffcac25 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 21:04:35.450853 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-915e1bf9-bc8c-4a68-9bf4-d8a40a8c98a4 tempest-VolumesGetTestJSON-1626588404 tempest-VolumesGetTestJSON-1626588404-project] Calling method '.version_select at 0x7f96ea5b6af0>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:35.974101 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.wsgi [None req-915e1bf9-bc8c-4a68-9bf4-d8a40a8c98a4 tempest-VolumesGetTestJSON-1626588404 tempest-VolumesGetTestJSON-1626588404-project] HTTP exception thrown: Volume 541eb19a-0589-409f-aaa2-da07fffcac25 could not be found. Jul 13 21:04:35.979052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-915e1bf9-bc8c-4a68-9bf4-d8a40a8c98a4 tempest-VolumesGetTestJSON-1626588404 tempest-VolumesGetTestJSON-1626588404-project] Request method failure captured: Jul 13 21:04:35.979052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: request: GET /compute/v2.1/os-volumes/541eb19a-0589-409f-aaa2-da07fffcac25 HTTP/1.1 Jul 13 21:04:35.979052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept: application/json Jul 13 21:04:35.979052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept-Encoding: identity Jul 13 21:04:35.979052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Connection: close Jul 13 21:04:35.979052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Length: 0 Jul 13 21:04:35.979052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Type: application/json Jul 13 21:04:35.979052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Host: 10.222.0.39 Jul 13 21:04:35.979052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Openstack-System-Scope: None Jul 13 21:04:35.979052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: User-Agent: python-urllib3/1.26.9 Jul 13 21:04:35.979052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Auth-Token: gAAAAABizzNdkXHltJF6ygKM-nMw69vf6MMqCLFIwum-zbAtwL7fu7AAtYPqJxJq3rbvq-Y5d39-GPh0-GoHfhBsEYri3DmBvp5J5mJly4BcvYcKiFazFSBLucGZ8S9usgvkszK-ZESwMKDnIbXpTWWK5B2FH5uKSK-leqXxzMwkLVaLV1oNS7w Jul 13 21:04:35.979052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Id: None Jul 13 21:04:35.979052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Name: None Jul 13 21:04:35.979052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Identity-Status: Confirmed Jul 13 21:04:35.979052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Is-Admin-Project: True Jul 13 21:04:35.979052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Id: default Jul 13 21:04:35.979052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Name: Default Jul 13 21:04:35.979052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Id: 93560bcf2e774cfa90a37675d206c510 Jul 13 21:04:35.979052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Name: tempest-VolumesGetTestJSON-1626588404 Jul 13 21:04:35.979052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Role: member,reader Jul 13 21:04:35.979052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Roles: member,reader Jul 13 21:04:35.980328 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/93560bcf2e774cfa90a37675d206c510"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/93560bcf2e774cfa90a37675d206c510"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_93560bcf2e774cfa90a37675d206c510", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/93560bcf2e774cfa90a37675d206c510"}]}] Jul 13 21:04:35.980328 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant: tempest-VolumesGetTestJSON-1626588404 Jul 13 21:04:35.980328 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Id: 93560bcf2e774cfa90a37675d206c510 Jul 13 21:04:35.980328 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Name: tempest-VolumesGetTestJSON-1626588404 Jul 13 21:04:35.980328 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User: tempest-VolumesGetTestJSON-1626588404-project Jul 13 21:04:35.980328 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Id: default Jul 13 21:04:35.980328 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Name: Default Jul 13 21:04:35.980328 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Id: a5f7d2d0c8cc4a8db378ca436b0b56b2 Jul 13 21:04:35.980328 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Name: tempest-VolumesGetTestJSON-1626588404-project Jul 13 21:04:35.980328 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: method: Jul 13 21:04:35.980328 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: exception: Volume 541eb19a-0589-409f-aaa2-da07fffcac25 could not be found. Jul 13 21:04:35.980328 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: action_args: {'id': '541eb19a-0589-409f-aaa2-da07fffcac25'} Jul 13 21:04:35.980328 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:04:35.981109 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:04:35.981109 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 13 21:04:35.981109 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 13 21:04:35.981109 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 13 21:04:35.981109 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 13 21:04:35.981109 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 13 21:04:35.981109 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 13 21:04:35.981109 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 13 21:04:35.981109 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 13 21:04:35.981109 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 13 21:04:35.981109 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 13 21:04:35.981109 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 21:04:35.981109 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 21:04:35.981109 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 21:04:35.981109 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 21:04:35.981109 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 541eb19a-0589-409f-aaa2-da07fffcac25 could not be found. (HTTP 404) (Request-ID: req-eb8c37d8-24ea-4a3f-a3bb-40ebc9d8ed3f) Jul 13 21:04:35.981109 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:04:35.981109 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:04:35.981109 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:04:35.982114 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:04:35.982114 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 13 21:04:35.982114 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 13 21:04:35.982114 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 13 21:04:35.982114 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 13 21:04:35.982114 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 13 21:04:35.982114 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 13 21:04:35.982114 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 13 21:04:35.982114 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 13 21:04:35.982114 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 13 21:04:35.982114 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 13 21:04:35.982114 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 13 21:04:35.982114 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 13 21:04:35.982114 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 13 21:04:35.982114 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 13 21:04:35.982114 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 13 21:04:35.982114 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 13 21:04:35.982114 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 13 21:04:35.982114 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 13 21:04:35.983137 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 21:04:35.983137 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 21:04:35.983137 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 21:04:35.983137 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 21:04:35.983137 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 541eb19a-0589-409f-aaa2-da07fffcac25 could not be found. Jul 13 21:04:35.983137 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:04:35.983137 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:04:35.983137 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:04:35.983137 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:04:35.983137 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:04:35.983137 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:04:35.983137 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:04:35.983137 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:04:35.983137 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 13 21:04:35.983137 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 13 21:04:35.983137 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:04:35.983137 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:04:35.983137 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 13 21:04:35.983137 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:04:35.984225 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 541eb19a-0589-409f-aaa2-da07fffcac25 could not be found. Jul 13 21:04:35.984225 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:04:35.984225 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:04:35.984225 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:04:35.984225 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:04:35.984225 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:04:35.984225 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:04:35.984225 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:04:35.984225 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:04:35.984225 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 541eb19a-0589-409f-aaa2-da07fffcac25 could not be found. Jul 13 21:04:35.984225 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:04:35.984225 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-915e1bf9-bc8c-4a68-9bf4-d8a40a8c98a4 tempest-VolumesGetTestJSON-1626588404 tempest-VolumesGetTestJSON-1626588404-project] Returning 404 to user: Volume 541eb19a-0589-409f-aaa2-da07fffcac25 could not be found. {{(pid=118445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:04:35.984225 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-915e1bf9-bc8c-4a68-9bf4-d8a40a8c98a4 tempest-VolumesGetTestJSON-1626588404 tempest-VolumesGetTestJSON-1626588404-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/541eb19a-0589-409f-aaa2-da07fffcac25" status: 404 len: 109 microversion: 2.1 time: 0.537143 Jul 13 21:04:35.985896 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 6/9] 10.222.0.39 () {58 vars in 1244 bytes} [Wed Jul 13 21:04:35 2022] GET /compute/v2.1/os-volumes/541eb19a-0589-409f-aaa2-da07fffcac25 => generated 109 bytes in 543 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:04:36.267733 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-4c73835c-3aa9-4c6e-9c7d-3968a5598fad tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.084602 Jul 13 21:04:36.274051 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 4/10] 10.222.0.39 () {60 vars in 1161 bytes} [Wed Jul 13 21:04:35 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:04:36.282823 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-f18cc288-699f-4cc9-a2c6-693b2e80dcd8 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Calling method '.version_select at 0x7f96eaf4e040>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:36.470878 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-f18cc288-699f-4cc9-a2c6-693b2e80dcd8 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/5bb22b78-1ac4-4fa4-93aa-95d949158ff7" status: 200 len: 287 microversion: 2.1 time: 0.194922 Jul 13 21:04:36.471904 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 7/11] 10.222.0.39 () {58 vars in 1250 bytes} [Wed Jul 13 21:04:36 2022] GET /compute/v2.1/os-snapshots/5bb22b78-1ac4-4fa4-93aa-95d949158ff7 => generated 287 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:04:36.481899 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-26cccc2a-c542-471d-bf14-22b60c434e31 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Calling method '.version_select at 0x7f96ea5d0dc0>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:36.585718 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-26cccc2a-c542-471d-bf14-22b60c434e31 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.108073 Jul 13 21:04:36.586790 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 5/12] 10.222.0.39 () {58 vars in 1139 bytes} [Wed Jul 13 21:04:36 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:04:36.598324 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-b9361c94-69ba-4d29-970d-e546eb4df6e6 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Calling method '.version_select at 0x7f96ea5254c0>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:36.645238 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-b9361c94-69ba-4d29-970d-e546eb4df6e6 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/5bb22b78-1ac4-4fa4-93aa-95d949158ff7" status: 200 len: 287 microversion: 2.1 time: 0.050713 Jul 13 21:04:36.646246 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 8/13] 10.222.0.39 () {58 vars in 1250 bytes} [Wed Jul 13 21:04:36 2022] GET /compute/v2.1/os-snapshots/5bb22b78-1ac4-4fa4-93aa-95d949158ff7 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:04:37.657783 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-c590605c-15ee-480a-ba33-aa163e098ab6 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Calling method '.version_select at 0x7f96ea5d0af0>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:37.731506 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-c590605c-15ee-480a-ba33-aa163e098ab6 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/5bb22b78-1ac4-4fa4-93aa-95d949158ff7" status: 200 len: 287 microversion: 2.1 time: 0.078000 Jul 13 21:04:37.732531 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 6/14] 10.222.0.39 () {58 vars in 1250 bytes} [Wed Jul 13 21:04:37 2022] GET /compute/v2.1/os-snapshots/5bb22b78-1ac4-4fa4-93aa-95d949158ff7 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:04:38.743642 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-1e9bb5d8-6405-444d-a571-6b4691f0b305 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Calling method '.version_select at 0x7f96ea525b80>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:38.823493 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-1e9bb5d8-6405-444d-a571-6b4691f0b305 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/5bb22b78-1ac4-4fa4-93aa-95d949158ff7" status: 200 len: 287 microversion: 2.1 time: 0.083782 Jul 13 21:04:38.826020 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 9/15] 10.222.0.39 () {58 vars in 1250 bytes} [Wed Jul 13 21:04:38 2022] GET /compute/v2.1/os-snapshots/5bb22b78-1ac4-4fa4-93aa-95d949158ff7 => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:04:39.835838 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-416e6f11-c737-436a-a331-da0f43019baa tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Calling method '.version_select at 0x7f96ea53e280>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:39.907340 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-416e6f11-c737-436a-a331-da0f43019baa tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/5bb22b78-1ac4-4fa4-93aa-95d949158ff7" status: 200 len: 287 microversion: 2.1 time: 0.075254 Jul 13 21:04:39.908233 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 10/16] 10.222.0.39 () {58 vars in 1250 bytes} [Wed Jul 13 21:04:39 2022] GET /compute/v2.1/os-snapshots/5bb22b78-1ac4-4fa4-93aa-95d949158ff7 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:04:40.090515 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-6b4ff446-bcd6-47cc-a824-d00e7394e3aa tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Action: 'create', calling method: .version_select at 0x7f96ea5d0670>, body: {"keypair": {"name": "tempest-keypair-332840649", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpHSGKPCmyc5bWDZk5n5yc33yutMmVUnH+f8TBRfwwJB1kICRTB1pl5ownOLCEb3YII1+n4TIW7l5EdsPiCfUAdXjhGyIloQ3ksWgVqn6/k7QbnIiJI+gWpr91Ddt8E9w=="}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:04:40.216845 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.quota [None req-6b4ff446-bcd6-47cc-a824-d00e7394e3aa tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Getting quotas for project 91bc9f9f4bc04202aabc75fc4bb9a6b2. Resources: {'key_pairs'} {{(pid=118444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:04:40.236788 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.quota [None req-6b4ff446-bcd6-47cc-a824-d00e7394e3aa tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Getting quotas for user fc4afeb23348438eabfe22f1a975f9ab and project 91bc9f9f4bc04202aabc75fc4bb9a6b2. Resources: {'key_pairs'} {{(pid=118444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:04:40.373364 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-6b4ff446-bcd6-47cc-a824-d00e7394e3aa tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.549887 Jul 13 21:04:40.383328 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 7/17] 10.222.0.39 () {60 vars in 1158 bytes} [Wed Jul 13 21:04:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:04:40.919881 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-058fe971-5c50-438d-987a-fcb040ef7591 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Calling method '.version_select at 0x7f96ea525940>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:40.989057 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-058fe971-5c50-438d-987a-fcb040ef7591 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/5bb22b78-1ac4-4fa4-93aa-95d949158ff7" status: 200 len: 287 microversion: 2.1 time: 0.073246 Jul 13 21:04:40.990082 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 11/18] 10.222.0.39 () {58 vars in 1250 bytes} [Wed Jul 13 21:04:40 2022] GET /compute/v2.1/os-snapshots/5bb22b78-1ac4-4fa4-93aa-95d949158ff7 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:04:42.001520 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-bf4bd6e5-edf6-45b5-b3b3-736fec9938e8 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Calling method '.version_select at 0x7f96ea59eee0>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:42.069226 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-bf4bd6e5-edf6-45b5-b3b3-736fec9938e8 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/5bb22b78-1ac4-4fa4-93aa-95d949158ff7" status: 200 len: 287 microversion: 2.1 time: 0.071043 Jul 13 21:04:42.069798 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 8/19] 10.222.0.39 () {58 vars in 1250 bytes} [Wed Jul 13 21:04:41 2022] GET /compute/v2.1/os-snapshots/5bb22b78-1ac4-4fa4-93aa-95d949158ff7 => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:04:43.081785 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-1f04114a-31bc-49bc-8560-1559ada5c96d tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Calling method '.version_select at 0x7f96ea55b5e0>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:43.150996 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-1f04114a-31bc-49bc-8560-1559ada5c96d tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/5bb22b78-1ac4-4fa4-93aa-95d949158ff7" status: 200 len: 288 microversion: 2.1 time: 0.073178 Jul 13 21:04:43.151571 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 9/20] 10.222.0.39 () {58 vars in 1250 bytes} [Wed Jul 13 21:04:43 2022] GET /compute/v2.1/os-snapshots/5bb22b78-1ac4-4fa4-93aa-95d949158ff7 => generated 288 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:04:43.161889 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-762b0bce-d194-4a72-9fd2-3dfa844499ad tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Calling method '.version_select at 0x7f96ea55bca0>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:43.337301 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-762b0bce-d194-4a72-9fd2-3dfa844499ad tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "DELETE /compute/v2.1/os-snapshots/5bb22b78-1ac4-4fa4-93aa-95d949158ff7" status: 202 len: 0 microversion: 2.1 time: 0.178779 Jul 13 21:04:43.337662 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 10/21] 10.222.0.39 () {58 vars in 1253 bytes} [Wed Jul 13 21:04:43 2022] DELETE /compute/v2.1/os-snapshots/5bb22b78-1ac4-4fa4-93aa-95d949158ff7 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 13 21:04:43.345535 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-df2853bf-dcd9-405a-833e-3ee441307c58 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Action: 'create', calling method: .version_select at 0x7f96ea5253a0>, body: {"keypair": {"name": "tempest-keypair-113640619", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4BDiG8rZUeRHanNQgJg8hlmrFHG8CBDPZBCfjTMptTW+JkoQ4mjdJxRy08NzGpuBJhYJox+mNCOt7oNKDUiddwMIv0d/+xGqD9nVp+UakptKY5xEedRd6XKoGYBujvfg=="}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:04:43.352232 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-8d742a15-3fca-4a36-b1d6-d4c59632e466 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Calling method '.version_select at 0x7f96ea55bb80>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:43.402251 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-8d742a15-3fca-4a36-b1d6-d4c59632e466 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/5bb22b78-1ac4-4fa4-93aa-95d949158ff7" status: 200 len: 287 microversion: 2.1 time: 0.054423 Jul 13 21:04:43.402980 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 11/22] 10.222.0.39 () {58 vars in 1250 bytes} [Wed Jul 13 21:04:43 2022] GET /compute/v2.1/os-snapshots/5bb22b78-1ac4-4fa4-93aa-95d949158ff7 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:04:43.438485 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-df2853bf-dcd9-405a-833e-3ee441307c58 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Getting quotas for project 0a2703a8b75043e0ab0656482fa9ddeb. Resources: {'key_pairs'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:04:43.446375 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-df2853bf-dcd9-405a-833e-3ee441307c58 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Getting quotas for user d9cab6f67cd34c46886d036ba170331e and project 0a2703a8b75043e0ab0656482fa9ddeb. Resources: {'key_pairs'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:04:43.526747 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-df2853bf-dcd9-405a-833e-3ee441307c58 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.550439 Jul 13 21:04:43.527361 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 12/23] 10.222.0.39 () {60 vars in 1158 bytes} [Wed Jul 13 21:04:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:04:44.413767 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-2cdc10c4-82d8-453a-9309-8a5a689092fc tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Calling method '.version_select at 0x7f96ea55b4c0>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:44.483142 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-2cdc10c4-82d8-453a-9309-8a5a689092fc tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/5bb22b78-1ac4-4fa4-93aa-95d949158ff7" status: 200 len: 287 microversion: 2.1 time: 0.073520 Jul 13 21:04:44.484054 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 12/24] 10.222.0.39 () {58 vars in 1250 bytes} [Wed Jul 13 21:04:44 2022] GET /compute/v2.1/os-snapshots/5bb22b78-1ac4-4fa4-93aa-95d949158ff7 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:04:45.495943 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-e5b7382d-ebf8-407c-a322-1bbdb40f1743 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Calling method '.version_select at 0x7f96e9cb4280>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:45.570971 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-e5b7382d-ebf8-407c-a322-1bbdb40f1743 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/5bb22b78-1ac4-4fa4-93aa-95d949158ff7" status: 200 len: 287 microversion: 2.1 time: 0.079080 Jul 13 21:04:45.571695 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 13/25] 10.222.0.39 () {58 vars in 1250 bytes} [Wed Jul 13 21:04:45 2022] GET /compute/v2.1/os-snapshots/5bb22b78-1ac4-4fa4-93aa-95d949158ff7 => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:04:46.573964 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-3170ec67-0857-4b48-aba6-d541b3bf1819 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2067080912", "imageRef": "5a995c88-d784-4a51-a6b9-25aa9dfe607c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1f6f7a2a-f189-4026-be44-d6e67e387919"}], "security_groups": [{"name": "tempest-securitygroup--308175158"}], "key_name": "tempest-keypair-332840649", "user_data": "}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:04:46.584739 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-90f5bd37-4c6f-48a1-a068-a29edf3c73dd tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Calling method '.version_select at 0x7f96e9cb41f0>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:46.642929 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-90f5bd37-4c6f-48a1-a068-a29edf3c73dd tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/5bb22b78-1ac4-4fa4-93aa-95d949158ff7" status: 200 len: 287 microversion: 2.1 time: 0.063772 Jul 13 21:04:46.643506 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 14/26] 10.222.0.39 () {58 vars in 1250 bytes} [Wed Jul 13 21:04:46 2022] GET /compute/v2.1/os-snapshots/5bb22b78-1ac4-4fa4-93aa-95d949158ff7 => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:04:47.106901 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.network.neutron [None req-3170ec67-0857-4b48-aba6-d541b3bf1819 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] validate_networks() for [('1f6f7a2a-f189-4026-be44-d6e67e387919', None, None, None, None, None)] {{(pid=118444) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 21:04:47.150867 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-71411eb8-fdd2-4840-9f13-f6290fd37f0d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-278724916", "imageRef": "5a995c88-d784-4a51-a6b9-25aa9dfe607c", "flavorRef": "452", "networks": [{"uuid": "12aaf4aa-d2f1-4402-98aa-e7f21c370d14"}]}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:04:47.352394 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.network.neutron [None req-71411eb8-fdd2-4840-9f13-f6290fd37f0d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] validate_networks() for [('12aaf4aa-d2f1-4402-98aa-e7f21c370d14', None, None, None, None, None)] {{(pid=118445) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 21:04:48.820779 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-71411eb8-fdd2-4840-9f13-f6290fd37f0d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Flavor limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 21:04:48.821348 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-71411eb8-fdd2-4840-9f13-f6290fd37f0d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Image limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 21:04:48.821656 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-71411eb8-fdd2-4840-9f13-f6290fd37f0d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Flavor pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 21:04:48.822045 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-71411eb8-fdd2-4840-9f13-f6290fd37f0d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Image pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 21:04:48.822459 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-71411eb8-fdd2-4840-9f13-f6290fd37f0d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 21:04:48.845730 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-71411eb8-fdd2-4840-9f13-f6290fd37f0d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:48.846184 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-71411eb8-fdd2-4840-9f13-f6290fd37f0d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:48.856617 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-71411eb8-fdd2-4840-9f13-f6290fd37f0d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:48.858427 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-71411eb8-fdd2-4840-9f13-f6290fd37f0d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:48.876119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.virt.hardware [None req-3170ec67-0857-4b48-aba6-d541b3bf1819 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Flavor limits 0:0:0 {{(pid=118444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 21:04:48.876548 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.virt.hardware [None req-3170ec67-0857-4b48-aba6-d541b3bf1819 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Image limits 0:0:0 {{(pid=118444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 21:04:48.877222 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.virt.hardware [None req-3170ec67-0857-4b48-aba6-d541b3bf1819 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Flavor pref 0:0:0 {{(pid=118444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 21:04:48.877684 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.virt.hardware [None req-3170ec67-0857-4b48-aba6-d541b3bf1819 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Image pref 0:0:0 {{(pid=118444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 21:04:48.878098 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.virt.hardware [None req-3170ec67-0857-4b48-aba6-d541b3bf1819 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 21:04:48.914713 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3170ec67-0857-4b48-aba6-d541b3bf1819 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:48.915888 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3170ec67-0857-4b48-aba6-d541b3bf1819 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:48.918270 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3170ec67-0857-4b48-aba6-d541b3bf1819 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:48.921092 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3170ec67-0857-4b48-aba6-d541b3bf1819 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:48.929626 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-71411eb8-fdd2-4840-9f13-f6290fd37f0d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Getting quotas for project 9eb5da85f8a74b08aef7b37cc209ca92. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:04:48.937381 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-71411eb8-fdd2-4840-9f13-f6290fd37f0d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Getting quotas for user a28051d0f956461c8f3b39825e33af96 and project 9eb5da85f8a74b08aef7b37cc209ca92. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:04:48.960856 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.quota [None req-3170ec67-0857-4b48-aba6-d541b3bf1819 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Getting quotas for project 91bc9f9f4bc04202aabc75fc4bb9a6b2. Resources: {'cores', 'instances', 'ram'} {{(pid=118444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:04:48.968441 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-71411eb8-fdd2-4840-9f13-f6290fd37f0d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Going to run 1 instances... {{(pid=118445) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 21:04:48.975097 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-71411eb8-fdd2-4840-9f13-f6290fd37f0d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995c88-d784-4a51-a6b9-25aa9dfe607c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118445) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 21:04:48.987760 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.quota [None req-3170ec67-0857-4b48-aba6-d541b3bf1819 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Getting quotas for user fc4afeb23348438eabfe22f1a975f9ab and project 91bc9f9f4bc04202aabc75fc4bb9a6b2. Resources: {'cores', 'instances', 'ram'} {{(pid=118444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:04:49.015677 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-3170ec67-0857-4b48-aba6-d541b3bf1819 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Going to run 1 instances... {{(pid=118444) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 21:04:49.018549 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-3170ec67-0857-4b48-aba6-d541b3bf1819 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995c88-d784-4a51-a6b9-25aa9dfe607c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 21:04:49.077807 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-71411eb8-fdd2-4840-9f13-f6290fd37f0d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.373971 Jul 13 21:04:49.081819 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 15/27] 10.222.0.39 () {60 vars in 1146 bytes} [Wed Jul 13 21:04:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 21:04:49.191476 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-3170ec67-0857-4b48-aba6-d541b3bf1819 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.623107 Jul 13 21:04:49.192356 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 13/28] 10.222.0.39 () {60 vars in 1146 bytes} [Wed Jul 13 21:04:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 2626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 21:04:49.198965 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-4afdbcd6-95d1-433c-a39e-6e02822108e0 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Calling method '.version_select at 0x7f96e9c9a040>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:49.235302 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.wsgi [None req-4afdbcd6-95d1-433c-a39e-6e02822108e0 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] HTTP exception thrown: Snapshot 5bb22b78-1ac4-4fa4-93aa-95d949158ff7 could not be found. Jul 13 21:04:49.248274 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-4afdbcd6-95d1-433c-a39e-6e02822108e0 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Request method failure captured: Jul 13 21:04:49.248274 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: request: GET /compute/v2.1/os-snapshots/5bb22b78-1ac4-4fa4-93aa-95d949158ff7 HTTP/1.1 Jul 13 21:04:49.248274 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept: application/json Jul 13 21:04:49.248274 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept-Encoding: identity Jul 13 21:04:49.248274 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Connection: close Jul 13 21:04:49.248274 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Length: 0 Jul 13 21:04:49.248274 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Type: application/json Jul 13 21:04:49.248274 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Host: 10.222.0.39 Jul 13 21:04:49.248274 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Openstack-System-Scope: None Jul 13 21:04:49.248274 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: User-Agent: python-urllib3/1.26.9 Jul 13 21:04:49.248274 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Auth-Token: gAAAAABizzNd1tTInGDavxUAxzuvdmono4uVXYKbtzd2J3zlWflIpriDf58g_ejWqRaYXB2I8rvmhNY3PcW38HG2M5Bcc37mzjf0hqYEgASzYDRjGZcDqCKe3BtECfLGw2kO1D5G7hB9juCYpgeVv9tLisEtwQrQwygok4B0XwpTDrcJ1dxiizE Jul 13 21:04:49.248274 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Id: None Jul 13 21:04:49.248274 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Name: None Jul 13 21:04:49.248274 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Identity-Status: Confirmed Jul 13 21:04:49.248274 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Is-Admin-Project: True Jul 13 21:04:49.248274 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Id: default Jul 13 21:04:49.248274 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Name: Default Jul 13 21:04:49.248274 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Id: c317c7bdea394bcdbc0657fadedac2f7 Jul 13 21:04:49.248274 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-875955039 Jul 13 21:04:49.248274 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Role: member,reader Jul 13 21:04:49.248274 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Roles: member,reader Jul 13 21:04:49.249620 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c317c7bdea394bcdbc0657fadedac2f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c317c7bdea394bcdbc0657fadedac2f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c317c7bdea394bcdbc0657fadedac2f7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c317c7bdea394bcdbc0657fadedac2f7"}]}] Jul 13 21:04:49.249620 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant: tempest-VolumesSnapshotsTestJSON-875955039 Jul 13 21:04:49.249620 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Id: c317c7bdea394bcdbc0657fadedac2f7 Jul 13 21:04:49.249620 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-875955039 Jul 13 21:04:49.249620 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User: tempest-VolumesSnapshotsTestJSON-875955039-project Jul 13 21:04:49.249620 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Id: default Jul 13 21:04:49.249620 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Name: Default Jul 13 21:04:49.249620 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Id: 4711f2212b2b42b1bfe414d2795c6356 Jul 13 21:04:49.249620 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Name: tempest-VolumesSnapshotsTestJSON-875955039-project Jul 13 21:04:49.249620 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: method: Jul 13 21:04:49.249620 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: exception: Snapshot 5bb22b78-1ac4-4fa4-93aa-95d949158ff7 could not be found. Jul 13 21:04:49.249620 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: action_args: {'id': '5bb22b78-1ac4-4fa4-93aa-95d949158ff7'} Jul 13 21:04:49.249620 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:04:49.250429 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:04:49.250429 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 13 21:04:49.250429 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 13 21:04:49.250429 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 13 21:04:49.250429 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 13 21:04:49.250429 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 13 21:04:49.250429 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 13 21:04:49.250429 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 13 21:04:49.250429 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 13 21:04:49.250429 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 13 21:04:49.250429 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 13 21:04:49.250429 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 21:04:49.250429 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 21:04:49.250429 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 21:04:49.250429 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 21:04:49.250429 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5bb22b78-1ac4-4fa4-93aa-95d949158ff7 could not be found. (HTTP 404) (Request-ID: req-413c59cd-1418-4860-8410-5441aaf377cd) Jul 13 21:04:49.250429 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:04:49.250429 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:04:49.251838 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:04:49.251838 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:04:49.251838 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 13 21:04:49.251838 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 13 21:04:49.251838 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 13 21:04:49.251838 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 13 21:04:49.251838 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 13 21:04:49.251838 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 13 21:04:49.251838 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 13 21:04:49.251838 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 13 21:04:49.251838 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 13 21:04:49.251838 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 13 21:04:49.251838 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 13 21:04:49.251838 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 13 21:04:49.251838 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 13 21:04:49.251838 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 13 21:04:49.251838 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 13 21:04:49.251838 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 13 21:04:49.251838 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 13 21:04:49.252982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 13 21:04:49.252982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 21:04:49.252982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 21:04:49.252982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 21:04:49.252982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 21:04:49.252982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5bb22b78-1ac4-4fa4-93aa-95d949158ff7 could not be found. Jul 13 21:04:49.252982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:04:49.252982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:04:49.252982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:04:49.252982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:04:49.252982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:04:49.252982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:04:49.252982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:04:49.252982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:04:49.252982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 13 21:04:49.252982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 13 21:04:49.252982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:04:49.252982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:04:49.252982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 13 21:04:49.252982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:04:49.254140 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5bb22b78-1ac4-4fa4-93aa-95d949158ff7 could not be found. Jul 13 21:04:49.254140 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:04:49.254140 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:04:49.254140 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:04:49.254140 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:04:49.254140 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:04:49.254140 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:04:49.254140 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:04:49.254140 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:04:49.254140 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5bb22b78-1ac4-4fa4-93aa-95d949158ff7 could not be found. Jul 13 21:04:49.254140 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:04:49.254140 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-4afdbcd6-95d1-433c-a39e-6e02822108e0 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Returning 404 to user: Snapshot 5bb22b78-1ac4-4fa4-93aa-95d949158ff7 could not be found. {{(pid=118444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:04:49.266189 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-4afdbcd6-95d1-433c-a39e-6e02822108e0 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/5bb22b78-1ac4-4fa4-93aa-95d949158ff7" status: 404 len: 111 microversion: 2.1 time: 0.071761 Jul 13 21:04:49.267248 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 14/29] 10.222.0.39 () {58 vars in 1250 bytes} [Wed Jul 13 21:04:49 2022] GET /compute/v2.1/os-snapshots/5bb22b78-1ac4-4fa4-93aa-95d949158ff7 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:04:49.281054 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-cf41d62b-4145-47a9-8b9f-4e82fadf847d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1354666250", "imageRef": "5a995c88-d784-4a51-a6b9-25aa9dfe607c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0724e09-98b0-4f74-b483-93b3266239e7"}], "security_groups": [{"name": "tempest-securitygroup--428472822"}], "key_name": "tempest-keypair-113640619", "user_data": "}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:04:49.486536 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-45046494-e28f-4018-aa5c-27728b867645 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Action: 'create', calling method: .version_select at 0x7f96e9c52ca0>, body: {"keypair": {"name": "tempest-keypair-71669427", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBND1l/HjvaK9eYGn3E6Fr1NayRhUwAiaIm3ixMdauISe5ujG8z0uxQsVunsmXNJ0Ivz1F7JwJuMG6fNP/f67eVmGXK05oHdvCyiEEpUEGxf1jv9AaTRW7rC6Le+wpm0y9A=="}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:04:49.511788 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.network.neutron [None req-cf41d62b-4145-47a9-8b9f-4e82fadf847d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] validate_networks() for [('b0724e09-98b0-4f74-b483-93b3266239e7', None, None, None, None, None)] {{(pid=118444) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 21:04:49.543730 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-45046494-e28f-4018-aa5c-27728b867645 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Getting quotas for project e43ca8a5c9f2494fbb9c5c5509c5c79b. Resources: {'key_pairs'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:04:49.574590 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-45046494-e28f-4018-aa5c-27728b867645 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Getting quotas for user 0884a33a47e448e7826f257880a28964 and project e43ca8a5c9f2494fbb9c5c5509c5c79b. Resources: {'key_pairs'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:04:49.647514 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-45046494-e28f-4018-aa5c-27728b867645 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.564173 Jul 13 21:04:49.654502 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 16/30] 10.222.0.39 () {62 vars in 1199 bytes} [Wed Jul 13 21:04:49 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 566 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 13 21:04:49.661108 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-3ce60540-360d-4605-ac21-4873cb700633 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:49.661925 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-3ce60540-360d-4605-ac21-4873cb700633 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:49.942273 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3ce60540-360d-4605-ac21-4873cb700633 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:49.972041 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-3ce60540-360d-4605-ac21-4873cb700633 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1214 microversion: 2.1 time: 0.315290 Jul 13 21:04:49.979572 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 17/31] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:04:49 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1214 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:04:50.024791 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-e98e5f7d-48ad-4aab-b4b0-69a93bc24bcb tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:50.030754 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-e98e5f7d-48ad-4aab-b4b0-69a93bc24bcb tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:50.437512 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-e98e5f7d-48ad-4aab-b4b0-69a93bc24bcb tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:50.455656 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-e98e5f7d-48ad-4aab-b4b0-69a93bc24bcb tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1237 microversion: 2.1 time: 0.473310 Jul 13 21:04:50.460595 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 18/32] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:04:49 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1237 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:04:50.476842 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-2206bde1-b23b-419e-a526-fc0c62dbf5f2 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Calling method '.version_select at 0x7f96e9c0a790>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:50.611520 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.virt.hardware [None req-cf41d62b-4145-47a9-8b9f-4e82fadf847d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Flavor limits 0:0:0 {{(pid=118444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 21:04:50.613159 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.virt.hardware [None req-cf41d62b-4145-47a9-8b9f-4e82fadf847d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Image limits 0:0:0 {{(pid=118444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 21:04:50.614024 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.virt.hardware [None req-cf41d62b-4145-47a9-8b9f-4e82fadf847d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Flavor pref 0:0:0 {{(pid=118444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 21:04:50.616964 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.virt.hardware [None req-cf41d62b-4145-47a9-8b9f-4e82fadf847d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Image pref 0:0:0 {{(pid=118444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 21:04:50.617571 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.virt.hardware [None req-cf41d62b-4145-47a9-8b9f-4e82fadf847d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 21:04:50.633563 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-cf41d62b-4145-47a9-8b9f-4e82fadf847d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:50.636706 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-cf41d62b-4145-47a9-8b9f-4e82fadf847d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:50.639168 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-cf41d62b-4145-47a9-8b9f-4e82fadf847d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:50.642524 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-cf41d62b-4145-47a9-8b9f-4e82fadf847d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:50.678071 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-2206bde1-b23b-419e-a526-fc0c62dbf5f2 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08" status: 202 len: 0 microversion: 2.1 time: 0.212944 Jul 13 21:04:50.679191 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 19/33] 10.222.0.39 () {58 vars in 1247 bytes} [Wed Jul 13 21:04:50 2022] DELETE /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 21:04:50.688723 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-2d976c6e-27cb-41ce-a47d-65c81a2989e2 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Calling method '.version_select at 0x7f96e9c0adc0>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:50.720278 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.quota [None req-cf41d62b-4145-47a9-8b9f-4e82fadf847d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Getting quotas for project 0a2703a8b75043e0ab0656482fa9ddeb. Resources: {'cores', 'instances', 'ram'} {{(pid=118444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:04:50.729164 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.quota [None req-cf41d62b-4145-47a9-8b9f-4e82fadf847d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Getting quotas for user d9cab6f67cd34c46886d036ba170331e and project 0a2703a8b75043e0ab0656482fa9ddeb. Resources: {'cores', 'instances', 'ram'} {{(pid=118444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:04:50.758713 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-cf41d62b-4145-47a9-8b9f-4e82fadf847d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Going to run 1 instances... {{(pid=118444) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 21:04:50.760898 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-cf41d62b-4145-47a9-8b9f-4e82fadf847d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995c88-d784-4a51-a6b9-25aa9dfe607c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 21:04:50.854713 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-2d976c6e-27cb-41ce-a47d-65c81a2989e2 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08" status: 200 len: 345 microversion: 2.1 time: 0.171452 Jul 13 21:04:50.855290 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 20/34] 10.222.0.39 () {58 vars in 1244 bytes} [Wed Jul 13 21:04:50 2022] GET /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08 => generated 345 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:04:50.904331 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-cf41d62b-4145-47a9-8b9f-4e82fadf847d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.635921 Jul 13 21:04:50.918955 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 15/35] 10.222.0.39 () {60 vars in 1146 bytes} [Wed Jul 13 21:04:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 1651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 21:04:50.929484 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-d8a51b03-70cd-47e7-aeba-51ecb44c12d6 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:50.930426 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-d8a51b03-70cd-47e7-aeba-51ecb44c12d6 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:50.996145 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-d20209c2-cf76-452f-987e-c6878b4a187a tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:50.996758 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-d20209c2-cf76-452f-987e-c6878b4a187a tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:51.207068 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-d8a51b03-70cd-47e7-aeba-51ecb44c12d6 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:51.221263 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-d8a51b03-70cd-47e7-aeba-51ecb44c12d6 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1241 microversion: 2.1 time: 0.295031 Jul 13 21:04:51.222291 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 21/36] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:04:50 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1241 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:04:51.236826 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-d20209c2-cf76-452f-987e-c6878b4a187a tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:51.254374 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-d20209c2-cf76-452f-987e-c6878b4a187a tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1214 microversion: 2.1 time: 0.261872 Jul 13 21:04:51.255795 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 16/37] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:04:50 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1214 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:04:51.481589 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-635b4ac0-4fc7-4e83-bd21-1971be597433 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:51.482200 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-635b4ac0-4fc7-4e83-bd21-1971be597433 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:51.496577 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-635b4ac0-4fc7-4e83-bd21-1971be597433 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:51.500227 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-635b4ac0-4fc7-4e83-bd21-1971be597433 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:51.504857 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-635b4ac0-4fc7-4e83-bd21-1971be597433 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:51.508096 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-635b4ac0-4fc7-4e83-bd21-1971be597433 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:51.685828 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-635b4ac0-4fc7-4e83-bd21-1971be597433 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:51.701680 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-635b4ac0-4fc7-4e83-bd21-1971be597433 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1241 microversion: 2.1 time: 0.227190 Jul 13 21:04:51.702698 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 22/38] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:04:51 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1241 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:04:51.867066 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0b9ae4d4-41b2-451a-ba88-da1f05ee7ef6 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Calling method '.version_select at 0x7f96e9c6adc0>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:51.936707 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-0b9ae4d4-41b2-451a-ba88-da1f05ee7ef6 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08" status: 200 len: 345 microversion: 2.1 time: 0.073319 Jul 13 21:04:51.939041 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 17/39] 10.222.0.39 () {58 vars in 1244 bytes} [Wed Jul 13 21:04:51 2022] GET /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08 => generated 345 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:04:52.243528 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-737806fa-2376-41eb-a74b-bf71a8ce8490 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:52.244145 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-737806fa-2376-41eb-a74b-bf71a8ce8490 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:52.250429 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-737806fa-2376-41eb-a74b-bf71a8ce8490 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:52.251139 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-737806fa-2376-41eb-a74b-bf71a8ce8490 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:52.251963 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-737806fa-2376-41eb-a74b-bf71a8ce8490 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:52.252736 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-737806fa-2376-41eb-a74b-bf71a8ce8490 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:52.277196 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-927cb29f-4275-49a6-a46e-3a3f00db8307 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:52.277851 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-927cb29f-4275-49a6-a46e-3a3f00db8307 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:52.286431 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-927cb29f-4275-49a6-a46e-3a3f00db8307 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:52.287189 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-927cb29f-4275-49a6-a46e-3a3f00db8307 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:52.288121 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-927cb29f-4275-49a6-a46e-3a3f00db8307 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:52.288884 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-927cb29f-4275-49a6-a46e-3a3f00db8307 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:52.321030 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-737806fa-2376-41eb-a74b-bf71a8ce8490 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:52.328893 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-737806fa-2376-41eb-a74b-bf71a8ce8490 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1245 microversion: 2.1 time: 0.089851 Jul 13 21:04:52.329763 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 23/40] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:04:52 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:04:52.336200 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-e469f4c4-a3a3-4036-a25b-b2c8c2bfeea1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1694174572", "imageRef": "5a995c88-d784-4a51-a6b9-25aa9dfe607c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e4e5de2-72e4-405c-8aa3-edc28c7af7f6"}], "security_groups": [{"name": "tempest-securitygroup--2113449364"}], "key_name": "tempest-keypair-71669427", "user_data": "}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:04:52.471116 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-927cb29f-4275-49a6-a46e-3a3f00db8307 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:52.492032 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.network.neutron [None req-e469f4c4-a3a3-4036-a25b-b2c8c2bfeea1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] validate_networks() for [('4e4e5de2-72e4-405c-8aa3-edc28c7af7f6', None, None, None, None, None)] {{(pid=118445) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 21:04:52.502515 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-927cb29f-4275-49a6-a46e-3a3f00db8307 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1218 microversion: 2.1 time: 0.233556 Jul 13 21:04:52.503591 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 18/41] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:04:52 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1218 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:04:52.720962 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-23ec641d-4936-4e71-a9de-f0314d4ef6e6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:52.721843 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-23ec641d-4936-4e71-a9de-f0314d4ef6e6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:52.728729 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-23ec641d-4936-4e71-a9de-f0314d4ef6e6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:52.729185 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-23ec641d-4936-4e71-a9de-f0314d4ef6e6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:52.729958 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-23ec641d-4936-4e71-a9de-f0314d4ef6e6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:52.730399 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-23ec641d-4936-4e71-a9de-f0314d4ef6e6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:52.867447 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-23ec641d-4936-4e71-a9de-f0314d4ef6e6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:52.877388 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-23ec641d-4936-4e71-a9de-f0314d4ef6e6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1241 microversion: 2.1 time: 0.160545 Jul 13 21:04:52.879511 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 19/42] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:04:52 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1241 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:04:52.917970 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-e469f4c4-a3a3-4036-a25b-b2c8c2bfeea1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Flavor limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 21:04:52.918463 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-e469f4c4-a3a3-4036-a25b-b2c8c2bfeea1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Image limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 21:04:52.919046 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-e469f4c4-a3a3-4036-a25b-b2c8c2bfeea1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Flavor pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 21:04:52.919520 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-e469f4c4-a3a3-4036-a25b-b2c8c2bfeea1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Image pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 21:04:52.919996 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-e469f4c4-a3a3-4036-a25b-b2c8c2bfeea1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 21:04:52.932642 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e469f4c4-a3a3-4036-a25b-b2c8c2bfeea1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:52.933374 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e469f4c4-a3a3-4036-a25b-b2c8c2bfeea1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:52.934233 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e469f4c4-a3a3-4036-a25b-b2c8c2bfeea1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:52.934773 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e469f4c4-a3a3-4036-a25b-b2c8c2bfeea1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:52.949282 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ce6f4da0-3ef7-416d-9557-396a7ea96830 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Calling method '.version_select at 0x7f96e8b915e0>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:52.954299 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-e469f4c4-a3a3-4036-a25b-b2c8c2bfeea1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Getting quotas for project e43ca8a5c9f2494fbb9c5c5509c5c79b. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:04:52.970982 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-e469f4c4-a3a3-4036-a25b-b2c8c2bfeea1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Getting quotas for user 0884a33a47e448e7826f257880a28964 and project e43ca8a5c9f2494fbb9c5c5509c5c79b. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:04:52.984977 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-e469f4c4-a3a3-4036-a25b-b2c8c2bfeea1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Going to run 1 instances... {{(pid=118445) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 21:04:52.987285 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-e469f4c4-a3a3-4036-a25b-b2c8c2bfeea1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995c88-d784-4a51-a6b9-25aa9dfe607c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118445) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 21:04:53.010052 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ce6f4da0-3ef7-416d-9557-396a7ea96830 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08" status: 200 len: 345 microversion: 2.1 time: 0.064323 Jul 13 21:04:53.010778 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 20/43] 10.222.0.39 () {58 vars in 1244 bytes} [Wed Jul 13 21:04:52 2022] GET /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:04:53.042669 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-e469f4c4-a3a3-4036-a25b-b2c8c2bfeea1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.711549 Jul 13 21:04:53.043603 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 24/44] 10.222.0.39 () {62 vars in 1187 bytes} [Wed Jul 13 21:04:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 13 21:04:53.055245 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-7aa5ca9e-6288-4658-ae6a-ec5a8d2d2033 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:53.056519 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-7aa5ca9e-6288-4658-ae6a-ec5a8d2d2033 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:53.285942 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-7aa5ca9e-6288-4658-ae6a-ec5a8d2d2033 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:53.294570 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-7aa5ca9e-6288-4658-ae6a-ec5a8d2d2033 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:53.296750 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-7aa5ca9e-6288-4658-ae6a-ec5a8d2d2033 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:53.298138 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-7aa5ca9e-6288-4658-ae6a-ec5a8d2d2033 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1280 microversion: 2.20 time: 0.247943 Jul 13 21:04:53.300807 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 21/45] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:04:53 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1280 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:04:53.345566 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-9efa0ff9-d840-4f24-b4fb-bb0d41b361b8 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:53.347094 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-9efa0ff9-d840-4f24-b4fb-bb0d41b361b8 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:53.380161 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9efa0ff9-d840-4f24-b4fb-bb0d41b361b8 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:53.383006 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9efa0ff9-d840-4f24-b4fb-bb0d41b361b8 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:53.384604 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9efa0ff9-d840-4f24-b4fb-bb0d41b361b8 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:53.386558 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9efa0ff9-d840-4f24-b4fb-bb0d41b361b8 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:53.500217 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-9efa0ff9-d840-4f24-b4fb-bb0d41b361b8 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:53.515799 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-9efa0ff9-d840-4f24-b4fb-bb0d41b361b8 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1245 microversion: 2.1 time: 0.173002 Jul 13 21:04:53.519615 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 25/46] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:04:53 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1245 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:04:53.524948 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-95e561b9-ed26-4661-b773-4591209cb9a7 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:53.526104 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-95e561b9-ed26-4661-b773-4591209cb9a7 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:53.536246 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-95e561b9-ed26-4661-b773-4591209cb9a7 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:53.539909 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-95e561b9-ed26-4661-b773-4591209cb9a7 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:53.541269 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-95e561b9-ed26-4661-b773-4591209cb9a7 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:53.541911 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-95e561b9-ed26-4661-b773-4591209cb9a7 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:53.649280 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-95e561b9-ed26-4661-b773-4591209cb9a7 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:53.665696 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-95e561b9-ed26-4661-b773-4591209cb9a7 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1218 microversion: 2.1 time: 0.150320 Jul 13 21:04:53.674949 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 22/47] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:04:53 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1218 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:04:53.896792 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-81cfa105-01df-40fa-9555-344c7f88bfee tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:53.897592 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-81cfa105-01df-40fa-9555-344c7f88bfee tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:53.908955 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-81cfa105-01df-40fa-9555-344c7f88bfee tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:53.909761 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-81cfa105-01df-40fa-9555-344c7f88bfee tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:53.910694 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-81cfa105-01df-40fa-9555-344c7f88bfee tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:53.911249 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-81cfa105-01df-40fa-9555-344c7f88bfee tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:53.994416 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-81cfa105-01df-40fa-9555-344c7f88bfee tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:54.002383 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-81cfa105-01df-40fa-9555-344c7f88bfee tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1289 microversion: 2.1 time: 0.109905 Jul 13 21:04:54.004255 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 26/48] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:04:53 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1289 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:04:54.023180 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-26acb4f0-5089-4d7b-9d9b-c6d403c72016 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Calling method '.version_select at 0x7f96e8b20e50>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:54.073462 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-26acb4f0-5089-4d7b-9d9b-c6d403c72016 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08" status: 200 len: 345 microversion: 2.1 time: 0.054439 Jul 13 21:04:54.078519 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 23/49] 10.222.0.39 () {58 vars in 1244 bytes} [Wed Jul 13 21:04:54 2022] GET /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:04:54.319038 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c732be0d-5da9-4b71-9edb-01723f4dcbc8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:54.320342 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-c732be0d-5da9-4b71-9edb-01723f4dcbc8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:54.327767 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c732be0d-5da9-4b71-9edb-01723f4dcbc8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:54.328251 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c732be0d-5da9-4b71-9edb-01723f4dcbc8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:54.329094 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c732be0d-5da9-4b71-9edb-01723f4dcbc8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:54.329537 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c732be0d-5da9-4b71-9edb-01723f4dcbc8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:54.407753 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c732be0d-5da9-4b71-9edb-01723f4dcbc8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:54.417315 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c732be0d-5da9-4b71-9edb-01723f4dcbc8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:54.419716 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c732be0d-5da9-4b71-9edb-01723f4dcbc8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:54.421036 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-c732be0d-5da9-4b71-9edb-01723f4dcbc8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1332 microversion: 2.20 time: 0.108094 Jul 13 21:04:54.422068 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 27/50] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:04:54 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1332 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:04:54.534285 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-2ab330fb-9bcf-47d6-a2f4-ddb2336a5061 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:54.535277 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-2ab330fb-9bcf-47d6-a2f4-ddb2336a5061 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:54.562283 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2ab330fb-9bcf-47d6-a2f4-ddb2336a5061 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:54.562706 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2ab330fb-9bcf-47d6-a2f4-ddb2336a5061 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:54.565018 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2ab330fb-9bcf-47d6-a2f4-ddb2336a5061 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:54.569439 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2ab330fb-9bcf-47d6-a2f4-ddb2336a5061 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:54.675632 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-2ab330fb-9bcf-47d6-a2f4-ddb2336a5061 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:54.682361 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ec26fc54-2ba6-49ec-9fd5-5e8a97980003 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:54.683095 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ec26fc54-2ba6-49ec-9fd5-5e8a97980003 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:54.684702 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-2ab330fb-9bcf-47d6-a2f4-ddb2336a5061 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1293 microversion: 2.1 time: 0.155167 Jul 13 21:04:54.685447 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 24/51] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:04:54 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1293 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:04:54.689703 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ec26fc54-2ba6-49ec-9fd5-5e8a97980003 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:54.690153 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ec26fc54-2ba6-49ec-9fd5-5e8a97980003 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:54.690955 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ec26fc54-2ba6-49ec-9fd5-5e8a97980003 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:54.694224 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ec26fc54-2ba6-49ec-9fd5-5e8a97980003 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:54.767477 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ec26fc54-2ba6-49ec-9fd5-5e8a97980003 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:54.777779 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ec26fc54-2ba6-49ec-9fd5-5e8a97980003 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1274 microversion: 2.1 time: 0.099199 Jul 13 21:04:54.778358 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 28/52] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:04:54 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1274 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:04:55.021086 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-7eff37ef-ae71-41a9-998d-75e90038b0b5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:55.021848 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-7eff37ef-ae71-41a9-998d-75e90038b0b5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:55.031518 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7eff37ef-ae71-41a9-998d-75e90038b0b5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:55.035406 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7eff37ef-ae71-41a9-998d-75e90038b0b5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:55.036308 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7eff37ef-ae71-41a9-998d-75e90038b0b5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:55.037301 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7eff37ef-ae71-41a9-998d-75e90038b0b5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:55.085442 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-e43fd5f1-415a-4dda-894c-23ef06ebea01 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Calling method '.version_select at 0x7f96e8b84c10>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:55.162399 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-7eff37ef-ae71-41a9-998d-75e90038b0b5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:55.173162 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-7eff37ef-ae71-41a9-998d-75e90038b0b5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1289 microversion: 2.1 time: 0.156958 Jul 13 21:04:55.175395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 25/53] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:04:55 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1289 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:04:55.260156 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-e43fd5f1-415a-4dda-894c-23ef06ebea01 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08" status: 200 len: 345 microversion: 2.1 time: 0.178615 Jul 13 21:04:55.261375 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 29/54] 10.222.0.39 () {58 vars in 1244 bytes} [Wed Jul 13 21:04:55 2022] GET /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08 => generated 345 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:04:55.439438 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-1a0931ec-c3c2-422f-ad99-98aacce6eabe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:55.440052 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-1a0931ec-c3c2-422f-ad99-98aacce6eabe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:55.446425 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1a0931ec-c3c2-422f-ad99-98aacce6eabe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:55.447006 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1a0931ec-c3c2-422f-ad99-98aacce6eabe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:55.447884 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1a0931ec-c3c2-422f-ad99-98aacce6eabe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:55.448380 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1a0931ec-c3c2-422f-ad99-98aacce6eabe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:55.513390 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-1a0931ec-c3c2-422f-ad99-98aacce6eabe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:55.521737 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-1a0931ec-c3c2-422f-ad99-98aacce6eabe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:55.523286 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-1a0931ec-c3c2-422f-ad99-98aacce6eabe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:55.524365 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-1a0931ec-c3c2-422f-ad99-98aacce6eabe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1332 microversion: 2.20 time: 0.088878 Jul 13 21:04:55.524921 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 26/55] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:04:55 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1332 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:04:55.701773 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-a789642d-5e7f-4404-a21e-b6eb2878b750 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:55.702382 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-a789642d-5e7f-4404-a21e-b6eb2878b750 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:55.709138 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a789642d-5e7f-4404-a21e-b6eb2878b750 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:55.709595 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a789642d-5e7f-4404-a21e-b6eb2878b750 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:55.710355 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a789642d-5e7f-4404-a21e-b6eb2878b750 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:55.710827 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a789642d-5e7f-4404-a21e-b6eb2878b750 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:55.775570 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-a789642d-5e7f-4404-a21e-b6eb2878b750 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:55.782965 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-a789642d-5e7f-4404-a21e-b6eb2878b750 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1293 microversion: 2.1 time: 0.085006 Jul 13 21:04:55.783530 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 30/56] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:04:55 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:04:55.794642 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-3da2b4da-0975-4e87-9549-2650c4d1e6b8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:55.795259 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-3da2b4da-0975-4e87-9549-2650c4d1e6b8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:55.801142 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3da2b4da-0975-4e87-9549-2650c4d1e6b8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:55.801582 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3da2b4da-0975-4e87-9549-2650c4d1e6b8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:55.802356 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3da2b4da-0975-4e87-9549-2650c4d1e6b8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:55.802816 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3da2b4da-0975-4e87-9549-2650c4d1e6b8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:55.861719 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-3da2b4da-0975-4e87-9549-2650c4d1e6b8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:55.869380 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-3da2b4da-0975-4e87-9549-2650c4d1e6b8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1274 microversion: 2.1 time: 0.078475 Jul 13 21:04:55.869945 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 27/57] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:04:55 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1274 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:04:56.189416 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-6537a9a9-b619-4259-af5b-5eaea68a8ba7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:56.190018 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-6537a9a9-b619-4259-af5b-5eaea68a8ba7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:56.196605 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6537a9a9-b619-4259-af5b-5eaea68a8ba7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:56.197043 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6537a9a9-b619-4259-af5b-5eaea68a8ba7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:56.197790 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6537a9a9-b619-4259-af5b-5eaea68a8ba7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:56.198235 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6537a9a9-b619-4259-af5b-5eaea68a8ba7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:56.258993 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-6537a9a9-b619-4259-af5b-5eaea68a8ba7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:56.266215 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-6537a9a9-b619-4259-af5b-5eaea68a8ba7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1289 microversion: 2.1 time: 0.080638 Jul 13 21:04:56.266913 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 31/58] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:04:56 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1289 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:04:56.273010 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-126b5d37-c216-4736-9d44-379248cb235d tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Calling method '.version_select at 0x7f96e8b03430>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:56.320880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-126b5d37-c216-4736-9d44-379248cb235d tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08" status: 200 len: 345 microversion: 2.1 time: 0.051604 Jul 13 21:04:56.321438 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 28/59] 10.222.0.39 () {58 vars in 1244 bytes} [Wed Jul 13 21:04:56 2022] GET /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:04:56.542777 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-813a02c0-ab9a-4e1b-8843-1c430fe6830d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:56.543381 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-813a02c0-ab9a-4e1b-8843-1c430fe6830d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:56.549260 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-813a02c0-ab9a-4e1b-8843-1c430fe6830d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:56.549706 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-813a02c0-ab9a-4e1b-8843-1c430fe6830d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:56.550461 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-813a02c0-ab9a-4e1b-8843-1c430fe6830d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:56.550926 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-813a02c0-ab9a-4e1b-8843-1c430fe6830d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:56.609894 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-813a02c0-ab9a-4e1b-8843-1c430fe6830d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:56.618228 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-813a02c0-ab9a-4e1b-8843-1c430fe6830d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:56.619770 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-813a02c0-ab9a-4e1b-8843-1c430fe6830d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:56.620856 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-813a02c0-ab9a-4e1b-8843-1c430fe6830d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1332 microversion: 2.20 time: 0.081922 Jul 13 21:04:56.621412 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 32/60] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:04:56 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1332 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:04:56.800082 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-5f613682-a07d-4990-95ff-7b86b103ebd3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:56.800697 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-5f613682-a07d-4990-95ff-7b86b103ebd3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:56.807334 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5f613682-a07d-4990-95ff-7b86b103ebd3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:56.807789 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5f613682-a07d-4990-95ff-7b86b103ebd3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:56.808594 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5f613682-a07d-4990-95ff-7b86b103ebd3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:56.809033 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5f613682-a07d-4990-95ff-7b86b103ebd3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:56.870861 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-5f613682-a07d-4990-95ff-7b86b103ebd3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:56.878856 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-5f613682-a07d-4990-95ff-7b86b103ebd3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1293 microversion: 2.1 time: 0.083058 Jul 13 21:04:56.879420 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 29/61] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:04:56 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:04:56.885135 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-87b7552e-7b4f-46c1-a788-5b6da9993873 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:56.885770 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-87b7552e-7b4f-46c1-a788-5b6da9993873 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:56.891719 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-87b7552e-7b4f-46c1-a788-5b6da9993873 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:56.892163 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-87b7552e-7b4f-46c1-a788-5b6da9993873 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:56.892912 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-87b7552e-7b4f-46c1-a788-5b6da9993873 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:56.893350 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-87b7552e-7b4f-46c1-a788-5b6da9993873 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:56.953561 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-87b7552e-7b4f-46c1-a788-5b6da9993873 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:56.961287 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-87b7552e-7b4f-46c1-a788-5b6da9993873 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1274 microversion: 2.1 time: 0.079951 Jul 13 21:04:56.961846 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 33/62] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:04:56 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1274 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:04:57.283577 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-04c70c41-86fc-40fa-8a5a-2a707197688b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:57.284194 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-04c70c41-86fc-40fa-8a5a-2a707197688b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:57.290145 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-04c70c41-86fc-40fa-8a5a-2a707197688b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:57.290597 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-04c70c41-86fc-40fa-8a5a-2a707197688b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:57.291391 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-04c70c41-86fc-40fa-8a5a-2a707197688b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:57.291830 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-04c70c41-86fc-40fa-8a5a-2a707197688b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:57.333179 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-86f29e58-9f3d-4fef-b9b6-2d87c4c6517d tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Calling method '.version_select at 0x7f96e8b0c160>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:57.351841 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-04c70c41-86fc-40fa-8a5a-2a707197688b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:57.359089 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-04c70c41-86fc-40fa-8a5a-2a707197688b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1289 microversion: 2.1 time: 0.079376 Jul 13 21:04:57.359653 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 30/63] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:04:57 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1289 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:04:57.381248 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-86f29e58-9f3d-4fef-b9b6-2d87c4c6517d tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08" status: 200 len: 345 microversion: 2.1 time: 0.051152 Jul 13 21:04:57.381810 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 34/64] 10.222.0.39 () {58 vars in 1244 bytes} [Wed Jul 13 21:04:57 2022] GET /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:04:57.638478 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-1a71f15c-4720-4ea6-9759-fa79cae6ca7d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:57.639106 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-1a71f15c-4720-4ea6-9759-fa79cae6ca7d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:57.645014 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1a71f15c-4720-4ea6-9759-fa79cae6ca7d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:57.645463 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1a71f15c-4720-4ea6-9759-fa79cae6ca7d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:57.646217 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1a71f15c-4720-4ea6-9759-fa79cae6ca7d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:57.646679 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1a71f15c-4720-4ea6-9759-fa79cae6ca7d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:57.709485 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-1a71f15c-4720-4ea6-9759-fa79cae6ca7d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:57.717637 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-1a71f15c-4720-4ea6-9759-fa79cae6ca7d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:57.719202 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-1a71f15c-4720-4ea6-9759-fa79cae6ca7d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:57.720296 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-1a71f15c-4720-4ea6-9759-fa79cae6ca7d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1332 microversion: 2.20 time: 0.085665 Jul 13 21:04:57.720843 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 31/65] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:04:57 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1332 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:04:57.895473 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-8698843e-452f-4ab2-bb74-8edb895c6cce tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:57.896160 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8698843e-452f-4ab2-bb74-8edb895c6cce tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:57.902551 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8698843e-452f-4ab2-bb74-8edb895c6cce tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:57.903045 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8698843e-452f-4ab2-bb74-8edb895c6cce tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:57.903793 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8698843e-452f-4ab2-bb74-8edb895c6cce tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:57.904218 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8698843e-452f-4ab2-bb74-8edb895c6cce tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:57.966738 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8698843e-452f-4ab2-bb74-8edb895c6cce tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:57.974642 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-8698843e-452f-4ab2-bb74-8edb895c6cce tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1293 microversion: 2.1 time: 0.082529 Jul 13 21:04:57.975215 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 35/66] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:04:57 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:04:57.978567 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-eae884a2-02d2-47fd-ad5e-5108984150bb tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:57.979269 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-eae884a2-02d2-47fd-ad5e-5108984150bb tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:57.985313 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eae884a2-02d2-47fd-ad5e-5108984150bb tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:57.985752 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eae884a2-02d2-47fd-ad5e-5108984150bb tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:57.986508 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eae884a2-02d2-47fd-ad5e-5108984150bb tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:57.986957 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eae884a2-02d2-47fd-ad5e-5108984150bb tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:58.046782 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-eae884a2-02d2-47fd-ad5e-5108984150bb tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:58.054704 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-eae884a2-02d2-47fd-ad5e-5108984150bb tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1274 microversion: 2.1 time: 0.080405 Jul 13 21:04:58.055279 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 32/67] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:04:57 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1274 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:04:58.376438 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-b75d4a79-a059-44af-b7a8-1ee93c82c29d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:58.377137 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-b75d4a79-a059-44af-b7a8-1ee93c82c29d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:58.383943 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b75d4a79-a059-44af-b7a8-1ee93c82c29d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:58.384386 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b75d4a79-a059-44af-b7a8-1ee93c82c29d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:58.385204 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b75d4a79-a059-44af-b7a8-1ee93c82c29d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:58.385576 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b75d4a79-a059-44af-b7a8-1ee93c82c29d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:58.393366 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-53d4f847-5d88-4a60-b80c-3e190478fd6a tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Calling method '.version_select at 0x7f96e8b91ca0>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:58.467087 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-53d4f847-5d88-4a60-b80c-3e190478fd6a tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08" status: 200 len: 345 microversion: 2.1 time: 0.073800 Jul 13 21:04:58.472787 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 33/68] 10.222.0.39 () {58 vars in 1244 bytes} [Wed Jul 13 21:04:58 2022] GET /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08 => generated 345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:04:58.487257 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b75d4a79-a059-44af-b7a8-1ee93c82c29d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:58.497041 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-b75d4a79-a059-44af-b7a8-1ee93c82c29d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1289 microversion: 2.1 time: 0.124286 Jul 13 21:04:58.497638 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 36/69] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:04:58 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1289 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:04:58.738947 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ecf69f69-c292-47a4-9fbb-1c787a815081 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:58.739885 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-ecf69f69-c292-47a4-9fbb-1c787a815081 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:58.750143 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ecf69f69-c292-47a4-9fbb-1c787a815081 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:58.750931 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ecf69f69-c292-47a4-9fbb-1c787a815081 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:58.751882 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ecf69f69-c292-47a4-9fbb-1c787a815081 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:58.752589 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ecf69f69-c292-47a4-9fbb-1c787a815081 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:58.983465 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ecf69f69-c292-47a4-9fbb-1c787a815081 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:58.992316 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ecf69f69-c292-47a4-9fbb-1c787a815081 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:58.992962 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c7ba5c80-0d55-43a2-842d-0eb3a9f13a5d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:58.993626 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-c7ba5c80-0d55-43a2-842d-0eb3a9f13a5d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:58.995249 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ecf69f69-c292-47a4-9fbb-1c787a815081 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:58.996674 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ecf69f69-c292-47a4-9fbb-1c787a815081 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1340 microversion: 2.20 time: 0.262489 Jul 13 21:04:58.997441 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 34/70] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:04:58 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1340 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:04:59.001022 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c7ba5c80-0d55-43a2-842d-0eb3a9f13a5d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:59.001466 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c7ba5c80-0d55-43a2-842d-0eb3a9f13a5d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:59.002222 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c7ba5c80-0d55-43a2-842d-0eb3a9f13a5d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:59.002665 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c7ba5c80-0d55-43a2-842d-0eb3a9f13a5d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:59.075118 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-efa0041b-afb1-4fe8-ad64-e836d899ad1a tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:59.076354 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-efa0041b-afb1-4fe8-ad64-e836d899ad1a tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:59.092750 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-efa0041b-afb1-4fe8-ad64-e836d899ad1a tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:59.096393 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-efa0041b-afb1-4fe8-ad64-e836d899ad1a tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:59.098510 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-efa0041b-afb1-4fe8-ad64-e836d899ad1a tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:59.102432 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-efa0041b-afb1-4fe8-ad64-e836d899ad1a tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:59.162215 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c7ba5c80-0d55-43a2-842d-0eb3a9f13a5d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:59.169933 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-c7ba5c80-0d55-43a2-842d-0eb3a9f13a5d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1299 microversion: 2.1 time: 0.182467 Jul 13 21:04:59.170505 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 37/71] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:04:58 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1299 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:04:59.304677 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-efa0041b-afb1-4fe8-ad64-e836d899ad1a tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:59.316648 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-efa0041b-afb1-4fe8-ad64-e836d899ad1a tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1272 microversion: 2.1 time: 0.248728 Jul 13 21:04:59.319179 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 35/72] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:04:59 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1272 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:04:59.480249 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-71d8149c-6d78-4224-943d-f2d43797d408 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Calling method '.version_select at 0x7f96e8b57280>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:59.516751 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-aa5212e6-2896-40ec-991b-c2700d531b95 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:04:59.517410 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-aa5212e6-2896-40ec-991b-c2700d531b95 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:04:59.525355 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-aa5212e6-2896-40ec-991b-c2700d531b95 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:59.525799 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-aa5212e6-2896-40ec-991b-c2700d531b95 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:59.531736 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-aa5212e6-2896-40ec-991b-c2700d531b95 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:04:59.532196 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-aa5212e6-2896-40ec-991b-c2700d531b95 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:04:59.561302 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-71d8149c-6d78-4224-943d-f2d43797d408 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08" status: 200 len: 345 microversion: 2.1 time: 0.086313 Jul 13 21:04:59.562145 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 38/73] 10.222.0.39 () {58 vars in 1244 bytes} [Wed Jul 13 21:04:59 2022] GET /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08 => generated 345 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:04:59.738962 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-aa5212e6-2896-40ec-991b-c2700d531b95 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:04:59.769767 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-aa5212e6-2896-40ec-991b-c2700d531b95 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1295 microversion: 2.1 time: 0.258773 Jul 13 21:04:59.772017 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 36/74] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:04:59 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1295 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:00.017244 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-1541d7c3-83ae-42c4-a2d7-cce299402adc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:00.018379 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-1541d7c3-83ae-42c4-a2d7-cce299402adc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:00.028888 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1541d7c3-83ae-42c4-a2d7-cce299402adc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:00.029565 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1541d7c3-83ae-42c4-a2d7-cce299402adc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:00.030479 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1541d7c3-83ae-42c4-a2d7-cce299402adc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:00.031112 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1541d7c3-83ae-42c4-a2d7-cce299402adc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:00.187845 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-e0ae7f8d-739f-4795-b71d-336994eda4f4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:00.188718 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-e0ae7f8d-739f-4795-b71d-336994eda4f4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:00.199927 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e0ae7f8d-739f-4795-b71d-336994eda4f4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:00.200594 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e0ae7f8d-739f-4795-b71d-336994eda4f4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:00.201598 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e0ae7f8d-739f-4795-b71d-336994eda4f4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:00.208009 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e0ae7f8d-739f-4795-b71d-336994eda4f4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:00.656460 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell0:SELECT=4 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:05:00.920013 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-1541d7c3-83ae-42c4-a2d7-cce299402adc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:00.940052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-1541d7c3-83ae-42c4-a2d7-cce299402adc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:00.940583 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-1541d7c3-83ae-42c4-a2d7-cce299402adc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:00.942561 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-1541d7c3-83ae-42c4-a2d7-cce299402adc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1338 microversion: 2.20 time: 0.930408 Jul 13 21:05:00.946500 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 39/75] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:00 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1338 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:00.958204 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-2ca71d5a-7e1d-4f3c-aa07-766f57f166e0 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:00.959309 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-2ca71d5a-7e1d-4f3c-aa07-766f57f166e0 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:00.967407 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:05:00.972403 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2ca71d5a-7e1d-4f3c-aa07-766f57f166e0 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:00.975761 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2ca71d5a-7e1d-4f3c-aa07-766f57f166e0 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:00.977954 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2ca71d5a-7e1d-4f3c-aa07-766f57f166e0 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:00.978657 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2ca71d5a-7e1d-4f3c-aa07-766f57f166e0 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:01.087550 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-2ca71d5a-7e1d-4f3c-aa07-766f57f166e0 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:01.090653 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-e0ae7f8d-739f-4795-b71d-336994eda4f4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:01.105326 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-e0ae7f8d-739f-4795-b71d-336994eda4f4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.921730 Jul 13 21:05:01.105785 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-2ca71d5a-7e1d-4f3c-aa07-766f57f166e0 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1272 microversion: 2.1 time: 0.153985 Jul 13 21:05:01.107525 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 37/77] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:00 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:01.107883 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 40/77] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:00 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:01.119211 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-8f702075-ca7b-42ae-9787-cb19ba83a3ec tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:01.122334 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-8f702075-ca7b-42ae-9787-cb19ba83a3ec tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:01.133135 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c78077c3-29ae-41f6-b9d0-ced689c37c31 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Calling method '.version_select at 0x7f96e8b0caf0>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:01.140306 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8f702075-ca7b-42ae-9787-cb19ba83a3ec tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:01.140963 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8f702075-ca7b-42ae-9787-cb19ba83a3ec tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:01.142490 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8f702075-ca7b-42ae-9787-cb19ba83a3ec tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:01.143476 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8f702075-ca7b-42ae-9787-cb19ba83a3ec tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:01.189957 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.wsgi [None req-c78077c3-29ae-41f6-b9d0-ced689c37c31 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] HTTP exception thrown: Volume 0df7fa6f-6848-4c80-bd76-75ca86524d08 could not be found. Jul 13 21:05:01.192887 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c78077c3-29ae-41f6-b9d0-ced689c37c31 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Request method failure captured: Jul 13 21:05:01.192887 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: request: GET /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08 HTTP/1.1 Jul 13 21:05:01.192887 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept: application/json Jul 13 21:05:01.192887 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept-Encoding: identity Jul 13 21:05:01.192887 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Connection: close Jul 13 21:05:01.192887 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Length: 0 Jul 13 21:05:01.192887 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Type: application/json Jul 13 21:05:01.192887 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Host: 10.222.0.39 Jul 13 21:05:01.192887 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Openstack-System-Scope: None Jul 13 21:05:01.192887 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: User-Agent: python-urllib3/1.26.9 Jul 13 21:05:01.192887 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Auth-Token: gAAAAABizzNd1tTInGDavxUAxzuvdmono4uVXYKbtzd2J3zlWflIpriDf58g_ejWqRaYXB2I8rvmhNY3PcW38HG2M5Bcc37mzjf0hqYEgASzYDRjGZcDqCKe3BtECfLGw2kO1D5G7hB9juCYpgeVv9tLisEtwQrQwygok4B0XwpTDrcJ1dxiizE Jul 13 21:05:01.192887 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Id: None Jul 13 21:05:01.192887 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Name: None Jul 13 21:05:01.192887 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Identity-Status: Confirmed Jul 13 21:05:01.192887 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Is-Admin-Project: True Jul 13 21:05:01.192887 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Id: default Jul 13 21:05:01.192887 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Name: Default Jul 13 21:05:01.192887 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Id: c317c7bdea394bcdbc0657fadedac2f7 Jul 13 21:05:01.192887 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-875955039 Jul 13 21:05:01.192887 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Role: member,reader Jul 13 21:05:01.192887 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Roles: member,reader Jul 13 21:05:01.194371 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c317c7bdea394bcdbc0657fadedac2f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c317c7bdea394bcdbc0657fadedac2f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c317c7bdea394bcdbc0657fadedac2f7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c317c7bdea394bcdbc0657fadedac2f7"}]}] Jul 13 21:05:01.194371 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant: tempest-VolumesSnapshotsTestJSON-875955039 Jul 13 21:05:01.194371 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Id: c317c7bdea394bcdbc0657fadedac2f7 Jul 13 21:05:01.194371 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-875955039 Jul 13 21:05:01.194371 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User: tempest-VolumesSnapshotsTestJSON-875955039-project Jul 13 21:05:01.194371 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Id: default Jul 13 21:05:01.194371 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Name: Default Jul 13 21:05:01.194371 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Id: 4711f2212b2b42b1bfe414d2795c6356 Jul 13 21:05:01.194371 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Name: tempest-VolumesSnapshotsTestJSON-875955039-project Jul 13 21:05:01.194371 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: method: Jul 13 21:05:01.194371 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: exception: Volume 0df7fa6f-6848-4c80-bd76-75ca86524d08 could not be found. Jul 13 21:05:01.194371 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: action_args: {'id': '0df7fa6f-6848-4c80-bd76-75ca86524d08'} Jul 13 21:05:01.194371 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:05:01.205702 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:05:01.205702 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 13 21:05:01.205702 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 13 21:05:01.205702 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 13 21:05:01.205702 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 13 21:05:01.205702 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 13 21:05:01.205702 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 13 21:05:01.205702 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 13 21:05:01.205702 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 13 21:05:01.205702 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 13 21:05:01.205702 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 13 21:05:01.205702 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 21:05:01.205702 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 21:05:01.205702 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 21:05:01.205702 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 21:05:01.205702 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0df7fa6f-6848-4c80-bd76-75ca86524d08 could not be found. (HTTP 404) (Request-ID: req-6271e3b9-0635-4922-a326-d5a39b4cb225) Jul 13 21:05:01.205702 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:05:01.205702 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:05:01.205702 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:05:01.209749 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:05:01.209749 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 13 21:05:01.209749 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 13 21:05:01.209749 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 13 21:05:01.209749 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 13 21:05:01.209749 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 13 21:05:01.209749 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 13 21:05:01.209749 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 13 21:05:01.209749 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 13 21:05:01.209749 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 13 21:05:01.209749 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 13 21:05:01.209749 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 13 21:05:01.209749 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 13 21:05:01.209749 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 13 21:05:01.209749 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 13 21:05:01.209749 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 13 21:05:01.209749 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 13 21:05:01.209749 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 13 21:05:01.209749 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 13 21:05:01.211251 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 21:05:01.211251 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 21:05:01.211251 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 21:05:01.211251 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 21:05:01.211251 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0df7fa6f-6848-4c80-bd76-75ca86524d08 could not be found. Jul 13 21:05:01.211251 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:05:01.211251 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:05:01.211251 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:05:01.211251 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:05:01.211251 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:05:01.211251 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:05:01.211251 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:05:01.211251 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:05:01.211251 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 13 21:05:01.211251 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 13 21:05:01.211251 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:05:01.211251 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:05:01.211251 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 13 21:05:01.211251 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:05:01.212376 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0df7fa6f-6848-4c80-bd76-75ca86524d08 could not be found. Jul 13 21:05:01.212376 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:05:01.212376 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:05:01.212376 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:05:01.212376 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:05:01.212376 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:05:01.212376 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:05:01.212376 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:05:01.212376 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:05:01.212376 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0df7fa6f-6848-4c80-bd76-75ca86524d08 could not be found. Jul 13 21:05:01.212376 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:05:01.212376 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c78077c3-29ae-41f6-b9d0-ced689c37c31 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Returning 404 to user: Volume 0df7fa6f-6848-4c80-bd76-75ca86524d08 could not be found. {{(pid=118445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:05:01.212376 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-c78077c3-29ae-41f6-b9d0-ced689c37c31 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08" status: 404 len: 109 microversion: 2.1 time: 0.085390 Jul 13 21:05:01.212376 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 41/78] 10.222.0.39 () {58 vars in 1244 bytes} [Wed Jul 13 21:05:01 2022] GET /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:05:01.227526 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-220c3140-a4e5-4b3c-80fd-70f08fd0e122 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Calling method '.version_select at 0x7f96e8b575e0>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:01.309804 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.wsgi [None req-220c3140-a4e5-4b3c-80fd-70f08fd0e122 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] HTTP exception thrown: Volume 0df7fa6f-6848-4c80-bd76-75ca86524d08 could not be found. Jul 13 21:05:01.313072 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-220c3140-a4e5-4b3c-80fd-70f08fd0e122 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Request method failure captured: Jul 13 21:05:01.313072 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: request: DELETE /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08 HTTP/1.1 Jul 13 21:05:01.313072 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept: application/json Jul 13 21:05:01.313072 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept-Encoding: identity Jul 13 21:05:01.313072 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Connection: close Jul 13 21:05:01.313072 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Length: 0 Jul 13 21:05:01.313072 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Type: application/json Jul 13 21:05:01.313072 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Host: 10.222.0.39 Jul 13 21:05:01.313072 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Openstack-System-Scope: None Jul 13 21:05:01.313072 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: User-Agent: python-urllib3/1.26.9 Jul 13 21:05:01.313072 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Auth-Token: gAAAAABizzNd1tTInGDavxUAxzuvdmono4uVXYKbtzd2J3zlWflIpriDf58g_ejWqRaYXB2I8rvmhNY3PcW38HG2M5Bcc37mzjf0hqYEgASzYDRjGZcDqCKe3BtECfLGw2kO1D5G7hB9juCYpgeVv9tLisEtwQrQwygok4B0XwpTDrcJ1dxiizE Jul 13 21:05:01.313072 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Id: None Jul 13 21:05:01.313072 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Name: None Jul 13 21:05:01.313072 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Identity-Status: Confirmed Jul 13 21:05:01.313072 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Is-Admin-Project: True Jul 13 21:05:01.313072 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Id: default Jul 13 21:05:01.313072 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Name: Default Jul 13 21:05:01.313072 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Id: c317c7bdea394bcdbc0657fadedac2f7 Jul 13 21:05:01.313072 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-875955039 Jul 13 21:05:01.313072 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Role: member,reader Jul 13 21:05:01.313072 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Roles: member,reader Jul 13 21:05:01.314530 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c317c7bdea394bcdbc0657fadedac2f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c317c7bdea394bcdbc0657fadedac2f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c317c7bdea394bcdbc0657fadedac2f7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c317c7bdea394bcdbc0657fadedac2f7"}]}] Jul 13 21:05:01.314530 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant: tempest-VolumesSnapshotsTestJSON-875955039 Jul 13 21:05:01.314530 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Id: c317c7bdea394bcdbc0657fadedac2f7 Jul 13 21:05:01.314530 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-875955039 Jul 13 21:05:01.314530 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User: tempest-VolumesSnapshotsTestJSON-875955039-project Jul 13 21:05:01.314530 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Id: default Jul 13 21:05:01.314530 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Name: Default Jul 13 21:05:01.314530 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Id: 4711f2212b2b42b1bfe414d2795c6356 Jul 13 21:05:01.314530 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Name: tempest-VolumesSnapshotsTestJSON-875955039-project Jul 13 21:05:01.314530 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: method: Jul 13 21:05:01.314530 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: exception: Volume 0df7fa6f-6848-4c80-bd76-75ca86524d08 could not be found. Jul 13 21:05:01.314530 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: action_args: {'id': '0df7fa6f-6848-4c80-bd76-75ca86524d08'} Jul 13 21:05:01.314530 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:05:01.315451 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:05:01.315451 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 13 21:05:01.315451 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 13 21:05:01.315451 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 13 21:05:01.315451 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 13 21:05:01.315451 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 13 21:05:01.315451 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 13 21:05:01.315451 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 13 21:05:01.315451 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 13 21:05:01.315451 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 13 21:05:01.315451 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 13 21:05:01.315451 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 21:05:01.315451 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 21:05:01.315451 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 21:05:01.315451 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 21:05:01.315451 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0df7fa6f-6848-4c80-bd76-75ca86524d08 could not be found. (HTTP 404) (Request-ID: req-76c28f4a-b0a7-440f-9081-432de3698186) Jul 13 21:05:01.315451 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:05:01.315451 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:05:01.315451 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:05:01.316731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:05:01.316731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 13 21:05:01.316731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 13 21:05:01.316731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 13 21:05:01.316731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 13 21:05:01.316731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 13 21:05:01.316731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 13 21:05:01.316731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 13 21:05:01.316731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 13 21:05:01.316731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 13 21:05:01.316731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 13 21:05:01.316731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 13 21:05:01.316731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 13 21:05:01.316731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 13 21:05:01.316731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 13 21:05:01.316731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 13 21:05:01.316731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 13 21:05:01.316731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 13 21:05:01.316731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 13 21:05:01.318563 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 21:05:01.318563 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 21:05:01.318563 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 21:05:01.318563 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 21:05:01.318563 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0df7fa6f-6848-4c80-bd76-75ca86524d08 could not be found. Jul 13 21:05:01.318563 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:05:01.318563 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:05:01.318563 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:05:01.318563 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:05:01.318563 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:05:01.318563 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:05:01.318563 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:05:01.318563 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:05:01.318563 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 13 21:05:01.318563 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 13 21:05:01.318563 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:05:01.318563 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:05:01.318563 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 13 21:05:01.318563 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:05:01.319767 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0df7fa6f-6848-4c80-bd76-75ca86524d08 could not be found. Jul 13 21:05:01.319767 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:05:01.319767 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:05:01.319767 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:05:01.319767 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:05:01.319767 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:05:01.319767 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:05:01.319767 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:05:01.319767 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:05:01.319767 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0df7fa6f-6848-4c80-bd76-75ca86524d08 could not be found. Jul 13 21:05:01.319767 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:05:01.321421 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-220c3140-a4e5-4b3c-80fd-70f08fd0e122 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Returning 404 to user: Volume 0df7fa6f-6848-4c80-bd76-75ca86524d08 could not be found. {{(pid=118445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:05:01.322913 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-220c3140-a4e5-4b3c-80fd-70f08fd0e122 tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08" status: 404 len: 109 microversion: 2.1 time: 0.108207 Jul 13 21:05:01.328168 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 42/79] 10.222.0.39 () {58 vars in 1247 bytes} [Wed Jul 13 21:05:01 2022] DELETE /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08 => generated 109 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:05:01.333496 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-e151ed27-0677-4b14-8a22-a7a1af0cd52c tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Calling method '.version_select at 0x7f96e8b0c9d0>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:01.373030 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.wsgi [None req-e151ed27-0677-4b14-8a22-a7a1af0cd52c tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] HTTP exception thrown: Volume 0df7fa6f-6848-4c80-bd76-75ca86524d08 could not be found. Jul 13 21:05:01.375391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-e151ed27-0677-4b14-8a22-a7a1af0cd52c tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Request method failure captured: Jul 13 21:05:01.375391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: request: GET /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08 HTTP/1.1 Jul 13 21:05:01.375391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept: application/json Jul 13 21:05:01.375391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept-Encoding: identity Jul 13 21:05:01.375391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Connection: close Jul 13 21:05:01.375391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Length: 0 Jul 13 21:05:01.375391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Type: application/json Jul 13 21:05:01.375391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Host: 10.222.0.39 Jul 13 21:05:01.375391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Openstack-System-Scope: None Jul 13 21:05:01.375391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: User-Agent: python-urllib3/1.26.9 Jul 13 21:05:01.375391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Auth-Token: gAAAAABizzNd1tTInGDavxUAxzuvdmono4uVXYKbtzd2J3zlWflIpriDf58g_ejWqRaYXB2I8rvmhNY3PcW38HG2M5Bcc37mzjf0hqYEgASzYDRjGZcDqCKe3BtECfLGw2kO1D5G7hB9juCYpgeVv9tLisEtwQrQwygok4B0XwpTDrcJ1dxiizE Jul 13 21:05:01.375391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Id: None Jul 13 21:05:01.375391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Name: None Jul 13 21:05:01.375391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Identity-Status: Confirmed Jul 13 21:05:01.375391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Is-Admin-Project: True Jul 13 21:05:01.375391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Id: default Jul 13 21:05:01.375391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Name: Default Jul 13 21:05:01.375391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Id: c317c7bdea394bcdbc0657fadedac2f7 Jul 13 21:05:01.375391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-875955039 Jul 13 21:05:01.375391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Role: member,reader Jul 13 21:05:01.375391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Roles: member,reader Jul 13 21:05:01.376557 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c317c7bdea394bcdbc0657fadedac2f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c317c7bdea394bcdbc0657fadedac2f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c317c7bdea394bcdbc0657fadedac2f7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c317c7bdea394bcdbc0657fadedac2f7"}]}] Jul 13 21:05:01.376557 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant: tempest-VolumesSnapshotsTestJSON-875955039 Jul 13 21:05:01.376557 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Id: c317c7bdea394bcdbc0657fadedac2f7 Jul 13 21:05:01.376557 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-875955039 Jul 13 21:05:01.376557 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User: tempest-VolumesSnapshotsTestJSON-875955039-project Jul 13 21:05:01.376557 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Id: default Jul 13 21:05:01.376557 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Name: Default Jul 13 21:05:01.376557 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Id: 4711f2212b2b42b1bfe414d2795c6356 Jul 13 21:05:01.376557 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Name: tempest-VolumesSnapshotsTestJSON-875955039-project Jul 13 21:05:01.376557 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: method: Jul 13 21:05:01.376557 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: exception: Volume 0df7fa6f-6848-4c80-bd76-75ca86524d08 could not be found. Jul 13 21:05:01.376557 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: action_args: {'id': '0df7fa6f-6848-4c80-bd76-75ca86524d08'} Jul 13 21:05:01.376557 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:05:01.377249 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:05:01.377249 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 13 21:05:01.377249 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 13 21:05:01.377249 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 13 21:05:01.377249 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 13 21:05:01.377249 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 13 21:05:01.377249 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 13 21:05:01.377249 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 13 21:05:01.377249 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 13 21:05:01.377249 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 13 21:05:01.377249 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 13 21:05:01.377249 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 21:05:01.377249 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 21:05:01.377249 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 21:05:01.377249 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 21:05:01.377249 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0df7fa6f-6848-4c80-bd76-75ca86524d08 could not be found. (HTTP 404) (Request-ID: req-6abb5df6-b9db-4f90-8882-fce022371939) Jul 13 21:05:01.377249 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:05:01.377249 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:05:01.377249 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:05:01.378193 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:05:01.378193 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 13 21:05:01.378193 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 13 21:05:01.378193 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 13 21:05:01.378193 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 13 21:05:01.378193 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 13 21:05:01.378193 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 13 21:05:01.378193 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 13 21:05:01.378193 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 13 21:05:01.378193 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 13 21:05:01.378193 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 13 21:05:01.378193 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 13 21:05:01.378193 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 13 21:05:01.378193 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 13 21:05:01.378193 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 13 21:05:01.378193 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 13 21:05:01.378193 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 13 21:05:01.378193 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 13 21:05:01.378193 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 13 21:05:01.379140 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 21:05:01.379140 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 21:05:01.379140 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 21:05:01.379140 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 21:05:01.379140 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0df7fa6f-6848-4c80-bd76-75ca86524d08 could not be found. Jul 13 21:05:01.379140 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:05:01.379140 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:05:01.379140 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:05:01.379140 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:05:01.379140 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:05:01.379140 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:05:01.379140 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:05:01.379140 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:05:01.379140 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 13 21:05:01.379140 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 13 21:05:01.379140 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:05:01.379140 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:05:01.379140 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 13 21:05:01.379140 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:05:01.380135 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0df7fa6f-6848-4c80-bd76-75ca86524d08 could not be found. Jul 13 21:05:01.380135 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:05:01.380135 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:05:01.380135 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:05:01.380135 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:05:01.380135 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:05:01.380135 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:05:01.380135 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:05:01.380135 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:05:01.380135 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0df7fa6f-6848-4c80-bd76-75ca86524d08 could not be found. Jul 13 21:05:01.380135 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:05:01.383391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-e151ed27-0677-4b14-8a22-a7a1af0cd52c tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] Returning 404 to user: Volume 0df7fa6f-6848-4c80-bd76-75ca86524d08 could not be found. {{(pid=118445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:05:01.384516 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-e151ed27-0677-4b14-8a22-a7a1af0cd52c tempest-VolumesSnapshotsTestJSON-875955039 tempest-VolumesSnapshotsTestJSON-875955039-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08" status: 404 len: 109 microversion: 2.1 time: 0.055134 Jul 13 21:05:01.385242 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 43/80] 10.222.0.39 () {58 vars in 1244 bytes} [Wed Jul 13 21:05:01 2022] GET /compute/v2.1/os-volumes/0df7fa6f-6848-4c80-bd76-75ca86524d08 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:05:01.581808 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-8f702075-ca7b-42ae-9787-cb19ba83a3ec tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:01.585287 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=100 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:05:01.590235 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-8f702075-ca7b-42ae-9787-cb19ba83a3ec tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1295 microversion: 2.1 time: 0.480317 Jul 13 21:05:01.601815 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 38/81] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:01 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1295 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:01.977286 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-e613bff5-e30d-4464-b71c-54a6fdb48969 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:01.977973 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-e613bff5-e30d-4464-b71c-54a6fdb48969 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:01.986213 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e613bff5-e30d-4464-b71c-54a6fdb48969 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:01.986827 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e613bff5-e30d-4464-b71c-54a6fdb48969 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:01.987875 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e613bff5-e30d-4464-b71c-54a6fdb48969 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:01.988567 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e613bff5-e30d-4464-b71c-54a6fdb48969 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:02.092267 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-e613bff5-e30d-4464-b71c-54a6fdb48969 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:02.096087 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=100 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:05:02.103393 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-e613bff5-e30d-4464-b71c-54a6fdb48969 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:02.104355 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-e613bff5-e30d-4464-b71c-54a6fdb48969 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:02.105482 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-e613bff5-e30d-4464-b71c-54a6fdb48969 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1338 microversion: 2.20 time: 0.135576 Jul 13 21:05:02.106403 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 44/82] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:01 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1338 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:02.132832 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-2c42cbc6-96d9-48ef-bde8-b42a5f32a093 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:02.133437 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-2c42cbc6-96d9-48ef-bde8-b42a5f32a093 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:02.133646 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-98d3c0a4-5ca6-4466-ba0e-a03f41693502 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:02.135528 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-98d3c0a4-5ca6-4466-ba0e-a03f41693502 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:02.144321 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2c42cbc6-96d9-48ef-bde8-b42a5f32a093 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:02.144828 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2c42cbc6-96d9-48ef-bde8-b42a5f32a093 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:02.146255 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2c42cbc6-96d9-48ef-bde8-b42a5f32a093 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:02.146824 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2c42cbc6-96d9-48ef-bde8-b42a5f32a093 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:02.147736 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-98d3c0a4-5ca6-4466-ba0e-a03f41693502 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:02.148504 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-98d3c0a4-5ca6-4466-ba0e-a03f41693502 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:02.149678 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-98d3c0a4-5ca6-4466-ba0e-a03f41693502 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:02.150576 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-98d3c0a4-5ca6-4466-ba0e-a03f41693502 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:02.520601 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-98d3c0a4-5ca6-4466-ba0e-a03f41693502 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:02.531696 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-98d3c0a4-5ca6-4466-ba0e-a03f41693502 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.402204 Jul 13 21:05:02.532277 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 45/83] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:02 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:02.559741 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-2c42cbc6-96d9-48ef-bde8-b42a5f32a093 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:02.571225 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-2c42cbc6-96d9-48ef-bde8-b42a5f32a093 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.440451 Jul 13 21:05:02.573400 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 39/84] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:02 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:02.609511 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-f5338709-c665-43de-86d6-1f1c0736db56 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:02.610121 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-f5338709-c665-43de-86d6-1f1c0736db56 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:02.621448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f5338709-c665-43de-86d6-1f1c0736db56 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:02.621900 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f5338709-c665-43de-86d6-1f1c0736db56 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:02.622734 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f5338709-c665-43de-86d6-1f1c0736db56 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:02.623189 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f5338709-c665-43de-86d6-1f1c0736db56 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:02.811916 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-f5338709-c665-43de-86d6-1f1c0736db56 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:02.833709 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-f5338709-c665-43de-86d6-1f1c0736db56 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.228020 Jul 13 21:05:02.834692 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 46/85] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:02 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:03.124008 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-8d734dba-04c6-4399-a0a0-5edc63d8ed30 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:03.124679 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-8d734dba-04c6-4399-a0a0-5edc63d8ed30 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:03.130741 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8d734dba-04c6-4399-a0a0-5edc63d8ed30 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:03.131245 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8d734dba-04c6-4399-a0a0-5edc63d8ed30 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:03.132012 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8d734dba-04c6-4399-a0a0-5edc63d8ed30 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:03.132496 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8d734dba-04c6-4399-a0a0-5edc63d8ed30 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:03.287185 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-8d734dba-04c6-4399-a0a0-5edc63d8ed30 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:03.290833 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell0:SELECT=20 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:05:03.299010 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-8d734dba-04c6-4399-a0a0-5edc63d8ed30 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:03.300518 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-8d734dba-04c6-4399-a0a0-5edc63d8ed30 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:03.301620 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-8d734dba-04c6-4399-a0a0-5edc63d8ed30 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.181871 Jul 13 21:05:03.302930 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 40/86] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:03 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:03.553261 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-bee84e27-a86d-49db-811b-f788f92d2737 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:03.553853 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-bee84e27-a86d-49db-811b-f788f92d2737 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:03.561725 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=4 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:05:03.563636 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=26 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:05:03.565637 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bee84e27-a86d-49db-811b-f788f92d2737 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:03.566087 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bee84e27-a86d-49db-811b-f788f92d2737 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:03.566873 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bee84e27-a86d-49db-811b-f788f92d2737 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:03.567281 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bee84e27-a86d-49db-811b-f788f92d2737 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:03.591649 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-85844d9c-2786-4207-b774-24e5d287e6d1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:03.592671 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-85844d9c-2786-4207-b774-24e5d287e6d1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:03.601195 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-85844d9c-2786-4207-b774-24e5d287e6d1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:03.602454 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-85844d9c-2786-4207-b774-24e5d287e6d1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:03.604704 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-85844d9c-2786-4207-b774-24e5d287e6d1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:03.605392 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-85844d9c-2786-4207-b774-24e5d287e6d1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:03.718752 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-bee84e27-a86d-49db-811b-f788f92d2737 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:03.729247 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-bee84e27-a86d-49db-811b-f788f92d2737 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.179589 Jul 13 21:05:03.729247 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 47/87] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:03 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:03.765942 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-85844d9c-2786-4207-b774-24e5d287e6d1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:03.779944 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-85844d9c-2786-4207-b774-24e5d287e6d1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.189809 Jul 13 21:05:03.779944 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 41/88] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:03 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:03.850379 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-e7061198-57a1-4046-b65d-27a95f9b43be tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:03.851003 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-e7061198-57a1-4046-b65d-27a95f9b43be tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:03.857074 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e7061198-57a1-4046-b65d-27a95f9b43be tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:03.857975 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e7061198-57a1-4046-b65d-27a95f9b43be tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:03.863369 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e7061198-57a1-4046-b65d-27a95f9b43be tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:03.863829 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e7061198-57a1-4046-b65d-27a95f9b43be tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:04.020012 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-e7061198-57a1-4046-b65d-27a95f9b43be tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:04.031885 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-e7061198-57a1-4046-b65d-27a95f9b43be tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.185308 Jul 13 21:05:04.034837 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 48/89] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:03 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:04.323561 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-275e192e-f679-47e7-b36a-8240ee499d16 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:04.325433 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-275e192e-f679-47e7-b36a-8240ee499d16 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:04.331800 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-275e192e-f679-47e7-b36a-8240ee499d16 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:04.332497 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-275e192e-f679-47e7-b36a-8240ee499d16 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:04.333623 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-275e192e-f679-47e7-b36a-8240ee499d16 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:04.334196 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-275e192e-f679-47e7-b36a-8240ee499d16 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:04.486179 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-275e192e-f679-47e7-b36a-8240ee499d16 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:04.497346 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-275e192e-f679-47e7-b36a-8240ee499d16 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:04.499151 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-275e192e-f679-47e7-b36a-8240ee499d16 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:04.500525 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-275e192e-f679-47e7-b36a-8240ee499d16 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.183296 Jul 13 21:05:04.501078 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 42/90] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:04 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:04.745344 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-56b6181e-8549-425b-a81e-53c7a7af6709 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:04.745939 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-56b6181e-8549-425b-a81e-53c7a7af6709 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:04.753476 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-56b6181e-8549-425b-a81e-53c7a7af6709 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:04.754093 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-56b6181e-8549-425b-a81e-53c7a7af6709 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:04.754961 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-56b6181e-8549-425b-a81e-53c7a7af6709 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:04.755332 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-56b6181e-8549-425b-a81e-53c7a7af6709 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:04.794963 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0ddbb604-71fa-40a5-b41d-afc94aa8db5c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:04.795870 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-0ddbb604-71fa-40a5-b41d-afc94aa8db5c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:04.806226 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0ddbb604-71fa-40a5-b41d-afc94aa8db5c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:04.808060 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0ddbb604-71fa-40a5-b41d-afc94aa8db5c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:04.810566 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0ddbb604-71fa-40a5-b41d-afc94aa8db5c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:04.811370 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0ddbb604-71fa-40a5-b41d-afc94aa8db5c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:04.910860 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-56b6181e-8549-425b-a81e-53c7a7af6709 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:04.921482 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-56b6181e-8549-425b-a81e-53c7a7af6709 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.179930 Jul 13 21:05:04.929830 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 49/91] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:04 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:04.988784 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-0ddbb604-71fa-40a5-b41d-afc94aa8db5c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:04.996452 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-0ddbb604-71fa-40a5-b41d-afc94aa8db5c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.206289 Jul 13 21:05:04.997007 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 43/92] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:04 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:05.048616 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-8889a06b-cd68-4748-94b8-8be2154f6a7a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:05.049232 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8889a06b-cd68-4748-94b8-8be2154f6a7a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:05.055297 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8889a06b-cd68-4748-94b8-8be2154f6a7a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:05.055749 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8889a06b-cd68-4748-94b8-8be2154f6a7a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:05.056535 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8889a06b-cd68-4748-94b8-8be2154f6a7a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:05.056975 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8889a06b-cd68-4748-94b8-8be2154f6a7a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:05.225158 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8889a06b-cd68-4748-94b8-8be2154f6a7a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:05.233318 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-8889a06b-cd68-4748-94b8-8be2154f6a7a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.188442 Jul 13 21:05:05.235217 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 50/93] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:05 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:05.521598 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-9aa5daea-a2bd-4304-b049-911b1ea2ac23 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:05.523448 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-9aa5daea-a2bd-4304-b049-911b1ea2ac23 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:05.526818 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:05:05.531887 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9aa5daea-a2bd-4304-b049-911b1ea2ac23 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:05.532635 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9aa5daea-a2bd-4304-b049-911b1ea2ac23 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:05.533757 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9aa5daea-a2bd-4304-b049-911b1ea2ac23 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:05.534706 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9aa5daea-a2bd-4304-b049-911b1ea2ac23 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:05.701239 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-9aa5daea-a2bd-4304-b049-911b1ea2ac23 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:05.709105 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-9aa5daea-a2bd-4304-b049-911b1ea2ac23 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:05.710910 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-9aa5daea-a2bd-4304-b049-911b1ea2ac23 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:05.712235 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-9aa5daea-a2bd-4304-b049-911b1ea2ac23 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.195768 Jul 13 21:05:05.723825 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 44/94] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:05 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:05.939775 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-84f259c5-81fb-43b6-bb8d-9e13aae801c0 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:05.940503 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-84f259c5-81fb-43b6-bb8d-9e13aae801c0 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:05.947397 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-84f259c5-81fb-43b6-bb8d-9e13aae801c0 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:05.948828 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-84f259c5-81fb-43b6-bb8d-9e13aae801c0 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:05.949767 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-84f259c5-81fb-43b6-bb8d-9e13aae801c0 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:05.950385 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-84f259c5-81fb-43b6-bb8d-9e13aae801c0 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:06.013656 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-8d3f1e94-41da-4b65-aacf-06a4fc928e2a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:06.014273 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-8d3f1e94-41da-4b65-aacf-06a4fc928e2a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:06.021703 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8d3f1e94-41da-4b65-aacf-06a4fc928e2a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:06.022302 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8d3f1e94-41da-4b65-aacf-06a4fc928e2a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:06.023345 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8d3f1e94-41da-4b65-aacf-06a4fc928e2a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:06.024233 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8d3f1e94-41da-4b65-aacf-06a4fc928e2a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:06.154989 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-84f259c5-81fb-43b6-bb8d-9e13aae801c0 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:06.165853 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-84f259c5-81fb-43b6-bb8d-9e13aae801c0 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.228961 Jul 13 21:05:06.167048 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 51/95] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:05 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:06.251279 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-93c1dbaf-ac58-489b-846d-143fc5ecaa0e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:06.251879 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-93c1dbaf-ac58-489b-846d-143fc5ecaa0e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:06.262756 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-93c1dbaf-ac58-489b-846d-143fc5ecaa0e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:06.263320 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-93c1dbaf-ac58-489b-846d-143fc5ecaa0e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:06.264202 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-93c1dbaf-ac58-489b-846d-143fc5ecaa0e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:06.264816 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-93c1dbaf-ac58-489b-846d-143fc5ecaa0e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:06.277727 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-8d3f1e94-41da-4b65-aacf-06a4fc928e2a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:06.285884 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-8d3f1e94-41da-4b65-aacf-06a4fc928e2a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.276633 Jul 13 21:05:06.286837 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 45/96] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:06 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:06.424991 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-93c1dbaf-ac58-489b-846d-143fc5ecaa0e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:06.433694 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-93c1dbaf-ac58-489b-846d-143fc5ecaa0e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.186152 Jul 13 21:05:06.434273 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 52/97] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:06 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:06.730459 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-f77dc4fb-dfcc-45a7-a3a7-9602d28826ff tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:06.731420 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-f77dc4fb-dfcc-45a7-a3a7-9602d28826ff tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:06.745244 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f77dc4fb-dfcc-45a7-a3a7-9602d28826ff tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:06.745866 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f77dc4fb-dfcc-45a7-a3a7-9602d28826ff tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:06.746781 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f77dc4fb-dfcc-45a7-a3a7-9602d28826ff tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:06.747430 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f77dc4fb-dfcc-45a7-a3a7-9602d28826ff tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:07.032357 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f77dc4fb-dfcc-45a7-a3a7-9602d28826ff tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:07.043469 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f77dc4fb-dfcc-45a7-a3a7-9602d28826ff tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:07.048823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f77dc4fb-dfcc-45a7-a3a7-9602d28826ff tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:07.050242 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-f77dc4fb-dfcc-45a7-a3a7-9602d28826ff tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.323955 Jul 13 21:05:07.053179 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 46/98] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:06 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:07.186945 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-f5c2be57-3a7f-450d-8f10-da03f437b144 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:07.188397 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-f5c2be57-3a7f-450d-8f10-da03f437b144 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:07.207755 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f5c2be57-3a7f-450d-8f10-da03f437b144 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:07.209590 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f5c2be57-3a7f-450d-8f10-da03f437b144 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:07.212437 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f5c2be57-3a7f-450d-8f10-da03f437b144 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:07.216240 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f5c2be57-3a7f-450d-8f10-da03f437b144 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:07.306148 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-88468026-6534-488e-8e98-ff2ba03b481b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:07.307540 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-88468026-6534-488e-8e98-ff2ba03b481b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:07.332338 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-88468026-6534-488e-8e98-ff2ba03b481b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:07.336758 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-88468026-6534-488e-8e98-ff2ba03b481b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:07.338144 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-88468026-6534-488e-8e98-ff2ba03b481b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:07.347994 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-88468026-6534-488e-8e98-ff2ba03b481b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:07.533514 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-f5c2be57-3a7f-450d-8f10-da03f437b144 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:07.543693 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-f5c2be57-3a7f-450d-8f10-da03f437b144 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.360796 Jul 13 21:05:07.555762 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 53/99] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:07 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:07.561043 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ed4bc190-f46f-4fae-93fc-e88ff6d453b6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:07.565768 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ed4bc190-f46f-4fae-93fc-e88ff6d453b6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:07.572993 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ed4bc190-f46f-4fae-93fc-e88ff6d453b6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:07.573614 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ed4bc190-f46f-4fae-93fc-e88ff6d453b6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:07.574652 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ed4bc190-f46f-4fae-93fc-e88ff6d453b6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:07.575249 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ed4bc190-f46f-4fae-93fc-e88ff6d453b6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:07.688749 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-88468026-6534-488e-8e98-ff2ba03b481b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:07.701511 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-88468026-6534-488e-8e98-ff2ba03b481b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.402637 Jul 13 21:05:07.702223 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 47/100] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:07 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:07.881142 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ed4bc190-f46f-4fae-93fc-e88ff6d453b6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:07.894059 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ed4bc190-f46f-4fae-93fc-e88ff6d453b6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.336643 Jul 13 21:05:07.894730 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 54/101] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:07 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:08.070387 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-2b366b58-3a3d-4aee-8d72-0404dcb085d2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:08.071021 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-2b366b58-3a3d-4aee-8d72-0404dcb085d2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:08.081525 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2b366b58-3a3d-4aee-8d72-0404dcb085d2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:08.082728 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2b366b58-3a3d-4aee-8d72-0404dcb085d2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:08.084815 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2b366b58-3a3d-4aee-8d72-0404dcb085d2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:08.085731 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2b366b58-3a3d-4aee-8d72-0404dcb085d2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:08.260406 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-2b366b58-3a3d-4aee-8d72-0404dcb085d2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:08.285232 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-2b366b58-3a3d-4aee-8d72-0404dcb085d2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:08.287121 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-2b366b58-3a3d-4aee-8d72-0404dcb085d2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:08.288348 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-2b366b58-3a3d-4aee-8d72-0404dcb085d2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.221931 Jul 13 21:05:08.289012 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 48/102] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:08 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:08.563931 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-9ae0fddc-4bbd-4e90-8759-c7257d92b4c6 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:08.564867 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-9ae0fddc-4bbd-4e90-8759-c7257d92b4c6 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:08.573852 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9ae0fddc-4bbd-4e90-8759-c7257d92b4c6 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:08.574895 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9ae0fddc-4bbd-4e90-8759-c7257d92b4c6 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:08.575934 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9ae0fddc-4bbd-4e90-8759-c7257d92b4c6 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:08.576731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9ae0fddc-4bbd-4e90-8759-c7257d92b4c6 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:08.721495 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ab57ed41-70b6-47d9-ab11-a5264504d1de tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:08.723059 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-ab57ed41-70b6-47d9-ab11-a5264504d1de tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:08.744160 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ab57ed41-70b6-47d9-ab11-a5264504d1de tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:08.747347 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ab57ed41-70b6-47d9-ab11-a5264504d1de tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:08.748143 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ab57ed41-70b6-47d9-ab11-a5264504d1de tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:08.750605 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ab57ed41-70b6-47d9-ab11-a5264504d1de tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:08.844862 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-9ae0fddc-4bbd-4e90-8759-c7257d92b4c6 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:08.859662 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-9ae0fddc-4bbd-4e90-8759-c7257d92b4c6 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.299344 Jul 13 21:05:08.860780 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 55/103] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:08 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:08.917485 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-46811f31-d99e-4ee2-8381-037397b28ea9 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:08.918475 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-46811f31-d99e-4ee2-8381-037397b28ea9 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:08.932580 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-46811f31-d99e-4ee2-8381-037397b28ea9 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:08.936176 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-46811f31-d99e-4ee2-8381-037397b28ea9 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:08.937692 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-46811f31-d99e-4ee2-8381-037397b28ea9 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:08.938337 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-46811f31-d99e-4ee2-8381-037397b28ea9 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:09.011990 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ab57ed41-70b6-47d9-ab11-a5264504d1de tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:09.021010 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ab57ed41-70b6-47d9-ab11-a5264504d1de tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.305594 Jul 13 21:05:09.021746 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 49/104] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:08 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:09.210732 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-46811f31-d99e-4ee2-8381-037397b28ea9 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:09.220182 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-46811f31-d99e-4ee2-8381-037397b28ea9 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.311163 Jul 13 21:05:09.221185 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 56/105] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:08 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:09.307819 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-133cd1a3-4d78-480f-9716-e54db8f89a4a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:09.308414 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-133cd1a3-4d78-480f-9716-e54db8f89a4a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:09.318897 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-133cd1a3-4d78-480f-9716-e54db8f89a4a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:09.318897 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-133cd1a3-4d78-480f-9716-e54db8f89a4a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:09.318897 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-133cd1a3-4d78-480f-9716-e54db8f89a4a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:09.318897 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-133cd1a3-4d78-480f-9716-e54db8f89a4a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:09.504280 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-133cd1a3-4d78-480f-9716-e54db8f89a4a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:09.516123 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-133cd1a3-4d78-480f-9716-e54db8f89a4a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:09.518725 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-133cd1a3-4d78-480f-9716-e54db8f89a4a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:09.520202 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-133cd1a3-4d78-480f-9716-e54db8f89a4a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.216232 Jul 13 21:05:09.521962 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 50/106] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:09 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:09.877516 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-8fe6c241-75a5-4f43-93ce-449e2299aa7f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:09.878202 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8fe6c241-75a5-4f43-93ce-449e2299aa7f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:09.888303 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8fe6c241-75a5-4f43-93ce-449e2299aa7f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:09.889783 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8fe6c241-75a5-4f43-93ce-449e2299aa7f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:09.891186 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8fe6c241-75a5-4f43-93ce-449e2299aa7f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:09.891528 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8fe6c241-75a5-4f43-93ce-449e2299aa7f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:10.039322 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-8627a66f-df5d-4506-8f04-015409c1d795 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:10.039765 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-8627a66f-df5d-4506-8f04-015409c1d795 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:10.048025 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8627a66f-df5d-4506-8f04-015409c1d795 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:10.056933 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8627a66f-df5d-4506-8f04-015409c1d795 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:10.059702 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8627a66f-df5d-4506-8f04-015409c1d795 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:10.060360 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8627a66f-df5d-4506-8f04-015409c1d795 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:10.134791 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8fe6c241-75a5-4f43-93ce-449e2299aa7f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:10.144997 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-8fe6c241-75a5-4f43-93ce-449e2299aa7f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.270685 Jul 13 21:05:10.146967 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 57/107] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:09 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:10.237346 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-abb219cf-1eeb-4914-a743-c05c12e6fa44 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:10.237949 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-abb219cf-1eeb-4914-a743-c05c12e6fa44 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:10.249780 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-abb219cf-1eeb-4914-a743-c05c12e6fa44 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:10.250540 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-abb219cf-1eeb-4914-a743-c05c12e6fa44 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:10.251529 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-abb219cf-1eeb-4914-a743-c05c12e6fa44 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:10.252147 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-abb219cf-1eeb-4914-a743-c05c12e6fa44 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:10.340054 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-8627a66f-df5d-4506-8f04-015409c1d795 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:10.367800 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-8627a66f-df5d-4506-8f04-015409c1d795 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.333265 Jul 13 21:05:10.370794 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 51/108] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:10 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:10.448435 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-abb219cf-1eeb-4914-a743-c05c12e6fa44 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:10.456079 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-abb219cf-1eeb-4914-a743-c05c12e6fa44 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.222577 Jul 13 21:05:10.456866 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 58/109] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:10 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:10.540424 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-f88745c7-1ac9-45bf-a17b-1773a86eee9f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:10.541508 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-f88745c7-1ac9-45bf-a17b-1773a86eee9f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:10.548683 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f88745c7-1ac9-45bf-a17b-1773a86eee9f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:10.549320 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f88745c7-1ac9-45bf-a17b-1773a86eee9f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:10.550341 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f88745c7-1ac9-45bf-a17b-1773a86eee9f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:10.551178 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f88745c7-1ac9-45bf-a17b-1773a86eee9f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:10.695958 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f88745c7-1ac9-45bf-a17b-1773a86eee9f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:10.704187 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f88745c7-1ac9-45bf-a17b-1773a86eee9f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:10.705686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f88745c7-1ac9-45bf-a17b-1773a86eee9f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:10.706886 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-f88745c7-1ac9-45bf-a17b-1773a86eee9f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.170912 Jul 13 21:05:10.707431 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 52/110] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:10 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:11.163278 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-bd58d1b0-3fae-4895-8109-2e1e96fb5c0f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:11.163958 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-bd58d1b0-3fae-4895-8109-2e1e96fb5c0f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:11.169772 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bd58d1b0-3fae-4895-8109-2e1e96fb5c0f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:11.170221 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bd58d1b0-3fae-4895-8109-2e1e96fb5c0f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:11.171202 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bd58d1b0-3fae-4895-8109-2e1e96fb5c0f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:11.171634 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bd58d1b0-3fae-4895-8109-2e1e96fb5c0f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:11.305066 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-bd58d1b0-3fae-4895-8109-2e1e96fb5c0f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:11.312462 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-bd58d1b0-3fae-4895-8109-2e1e96fb5c0f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.153552 Jul 13 21:05:11.313024 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 59/111] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:11 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:11.386408 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-6dba1403-634b-4a38-899a-635598577fdf tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:11.387169 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-6dba1403-634b-4a38-899a-635598577fdf tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:11.393411 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6dba1403-634b-4a38-899a-635598577fdf tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:11.393861 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6dba1403-634b-4a38-899a-635598577fdf tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:11.394674 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6dba1403-634b-4a38-899a-635598577fdf tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:11.395086 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6dba1403-634b-4a38-899a-635598577fdf tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:11.473250 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-70fefef5-9e51-4c61-8574-7e3e691ff8ce tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:11.474219 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-70fefef5-9e51-4c61-8574-7e3e691ff8ce tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:11.494885 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-70fefef5-9e51-4c61-8574-7e3e691ff8ce tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:11.495947 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-70fefef5-9e51-4c61-8574-7e3e691ff8ce tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:11.497219 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-70fefef5-9e51-4c61-8574-7e3e691ff8ce tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:11.497976 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-70fefef5-9e51-4c61-8574-7e3e691ff8ce tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:11.581303 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-6dba1403-634b-4a38-899a-635598577fdf tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:11.592009 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-6dba1403-634b-4a38-899a-635598577fdf tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.208953 Jul 13 21:05:11.593012 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 53/112] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:11 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:11.691333 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-70fefef5-9e51-4c61-8574-7e3e691ff8ce tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:11.700537 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-70fefef5-9e51-4c61-8574-7e3e691ff8ce tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.230985 Jul 13 21:05:11.701944 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 60/113] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:11 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:11.725220 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-9d300054-c10d-4587-9de9-00220e0c0ab7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:11.725847 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-9d300054-c10d-4587-9de9-00220e0c0ab7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:11.731793 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9d300054-c10d-4587-9de9-00220e0c0ab7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:11.732233 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9d300054-c10d-4587-9de9-00220e0c0ab7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:11.732985 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9d300054-c10d-4587-9de9-00220e0c0ab7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:11.733412 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9d300054-c10d-4587-9de9-00220e0c0ab7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:11.885036 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-9d300054-c10d-4587-9de9-00220e0c0ab7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:11.892793 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-9d300054-c10d-4587-9de9-00220e0c0ab7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:11.894268 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-9d300054-c10d-4587-9de9-00220e0c0ab7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:11.895428 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-9d300054-c10d-4587-9de9-00220e0c0ab7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.174086 Jul 13 21:05:11.895980 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 54/114] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:11 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:12.329456 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-666fa202-5466-40db-bc3b-1d56bee64ead tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:12.330090 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-666fa202-5466-40db-bc3b-1d56bee64ead tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:12.336334 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-666fa202-5466-40db-bc3b-1d56bee64ead tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:12.336781 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-666fa202-5466-40db-bc3b-1d56bee64ead tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:12.337613 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-666fa202-5466-40db-bc3b-1d56bee64ead tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:12.338068 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-666fa202-5466-40db-bc3b-1d56bee64ead tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:12.386358 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=100 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:05:12.529791 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-666fa202-5466-40db-bc3b-1d56bee64ead tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:12.538035 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-666fa202-5466-40db-bc3b-1d56bee64ead tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.212450 Jul 13 21:05:12.538624 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 61/115] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:12 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:12.617942 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-510aa17c-5673-4600-9b7e-069027eee4b1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:12.618561 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-510aa17c-5673-4600-9b7e-069027eee4b1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:12.626038 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-510aa17c-5673-4600-9b7e-069027eee4b1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:12.626713 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-510aa17c-5673-4600-9b7e-069027eee4b1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:12.627653 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-510aa17c-5673-4600-9b7e-069027eee4b1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:12.628347 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-510aa17c-5673-4600-9b7e-069027eee4b1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:12.662428 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=100 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:05:12.717698 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-0e8ad3f1-8052-4372-a943-e005e0d967e5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:12.718959 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-0e8ad3f1-8052-4372-a943-e005e0d967e5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:12.728772 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0e8ad3f1-8052-4372-a943-e005e0d967e5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:12.729301 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0e8ad3f1-8052-4372-a943-e005e0d967e5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:12.730151 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0e8ad3f1-8052-4372-a943-e005e0d967e5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:12.730685 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0e8ad3f1-8052-4372-a943-e005e0d967e5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:12.796311 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-510aa17c-5673-4600-9b7e-069027eee4b1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:12.804311 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-510aa17c-5673-4600-9b7e-069027eee4b1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.198762 Jul 13 21:05:12.805300 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 55/116] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:12 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:12.898527 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-0e8ad3f1-8052-4372-a943-e005e0d967e5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:12.906421 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-0e8ad3f1-8052-4372-a943-e005e0d967e5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.192531 Jul 13 21:05:12.908075 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 62/117] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:12 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:12.914335 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-7bc2231e-40f3-4d7d-b4a0-e1315ee88297 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:12.915045 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-7bc2231e-40f3-4d7d-b4a0-e1315ee88297 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:12.921160 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7bc2231e-40f3-4d7d-b4a0-e1315ee88297 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:12.921611 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7bc2231e-40f3-4d7d-b4a0-e1315ee88297 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:12.922368 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7bc2231e-40f3-4d7d-b4a0-e1315ee88297 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:12.922902 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7bc2231e-40f3-4d7d-b4a0-e1315ee88297 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:13.085383 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-7bc2231e-40f3-4d7d-b4a0-e1315ee88297 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:13.093634 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-7bc2231e-40f3-4d7d-b4a0-e1315ee88297 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:13.095285 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-7bc2231e-40f3-4d7d-b4a0-e1315ee88297 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:13.096651 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-7bc2231e-40f3-4d7d-b4a0-e1315ee88297 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.187100 Jul 13 21:05:13.096934 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 56/118] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:12 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:13.556539 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-95d00dc8-b15b-4d39-aafe-8001cf22edf8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:13.557799 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-95d00dc8-b15b-4d39-aafe-8001cf22edf8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:13.566350 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-95d00dc8-b15b-4d39-aafe-8001cf22edf8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:13.566858 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-95d00dc8-b15b-4d39-aafe-8001cf22edf8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:13.567755 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-95d00dc8-b15b-4d39-aafe-8001cf22edf8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:13.568191 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-95d00dc8-b15b-4d39-aafe-8001cf22edf8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:13.753593 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-95d00dc8-b15b-4d39-aafe-8001cf22edf8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:13.763917 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-95d00dc8-b15b-4d39-aafe-8001cf22edf8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.212909 Jul 13 21:05:13.765376 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 63/119] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:13 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:13.821112 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-577e6bee-c6de-47d1-80e8-951be0f07a7d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:13.831387 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-577e6bee-c6de-47d1-80e8-951be0f07a7d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:13.857867 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-577e6bee-c6de-47d1-80e8-951be0f07a7d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:13.857867 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-577e6bee-c6de-47d1-80e8-951be0f07a7d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:13.858340 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-577e6bee-c6de-47d1-80e8-951be0f07a7d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:13.859087 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-577e6bee-c6de-47d1-80e8-951be0f07a7d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:13.926111 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-5c946716-5ccf-4ce0-a839-006f13d4d3d0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:13.926831 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-5c946716-5ccf-4ce0-a839-006f13d4d3d0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:13.938680 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5c946716-5ccf-4ce0-a839-006f13d4d3d0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:13.940496 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5c946716-5ccf-4ce0-a839-006f13d4d3d0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:13.942936 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5c946716-5ccf-4ce0-a839-006f13d4d3d0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:13.944962 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5c946716-5ccf-4ce0-a839-006f13d4d3d0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:14.101492 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-577e6bee-c6de-47d1-80e8-951be0f07a7d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:14.109072 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-577e6bee-c6de-47d1-80e8-951be0f07a7d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.291984 Jul 13 21:05:14.109641 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 57/120] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:13 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:14.117529 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-99c0e764-ebac-446e-b216-c8ab24bde4c6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:14.118135 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-99c0e764-ebac-446e-b216-c8ab24bde4c6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:14.124596 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-99c0e764-ebac-446e-b216-c8ab24bde4c6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:14.125045 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-99c0e764-ebac-446e-b216-c8ab24bde4c6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:14.125812 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-99c0e764-ebac-446e-b216-c8ab24bde4c6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:14.126244 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-99c0e764-ebac-446e-b216-c8ab24bde4c6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:14.202930 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5c946716-5ccf-4ce0-a839-006f13d4d3d0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:14.212831 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-5c946716-5ccf-4ce0-a839-006f13d4d3d0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.292366 Jul 13 21:05:14.213941 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 64/121] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:13 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:14.269838 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-99c0e764-ebac-446e-b216-c8ab24bde4c6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:14.279980 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-99c0e764-ebac-446e-b216-c8ab24bde4c6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:14.281682 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-99c0e764-ebac-446e-b216-c8ab24bde4c6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:14.282887 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-99c0e764-ebac-446e-b216-c8ab24bde4c6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.171988 Jul 13 21:05:14.283464 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 58/122] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:14 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:14.783119 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-7edf456c-b6b3-4af4-8ba1-c809a5285faa tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:14.783725 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-7edf456c-b6b3-4af4-8ba1-c809a5285faa tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:14.789914 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7edf456c-b6b3-4af4-8ba1-c809a5285faa tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:14.790363 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7edf456c-b6b3-4af4-8ba1-c809a5285faa tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:14.791160 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7edf456c-b6b3-4af4-8ba1-c809a5285faa tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:14.791593 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7edf456c-b6b3-4af4-8ba1-c809a5285faa tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:14.922763 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-7edf456c-b6b3-4af4-8ba1-c809a5285faa tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:14.930559 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-7edf456c-b6b3-4af4-8ba1-c809a5285faa tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.151242 Jul 13 21:05:14.931154 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 65/123] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:14 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:15.126408 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-f87a94ee-2eea-4ee0-8856-e3ecd8140929 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:15.127777 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-f87a94ee-2eea-4ee0-8856-e3ecd8140929 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:15.134754 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f87a94ee-2eea-4ee0-8856-e3ecd8140929 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:15.135329 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f87a94ee-2eea-4ee0-8856-e3ecd8140929 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:15.136225 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f87a94ee-2eea-4ee0-8856-e3ecd8140929 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:15.136859 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f87a94ee-2eea-4ee0-8856-e3ecd8140929 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:15.231764 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-5011f466-9cc8-44d4-b248-a2c65e0159aa tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:15.232966 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-5011f466-9cc8-44d4-b248-a2c65e0159aa tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:15.242939 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5011f466-9cc8-44d4-b248-a2c65e0159aa tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:15.243779 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5011f466-9cc8-44d4-b248-a2c65e0159aa tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:15.245127 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5011f466-9cc8-44d4-b248-a2c65e0159aa tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:15.246073 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5011f466-9cc8-44d4-b248-a2c65e0159aa tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:15.279821 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f87a94ee-2eea-4ee0-8856-e3ecd8140929 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:15.290046 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-f87a94ee-2eea-4ee0-8856-e3ecd8140929 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.167876 Jul 13 21:05:15.290723 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 59/124] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:15 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:15.300642 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-755522ca-29f5-4a16-b718-d66809dfc915 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:15.302143 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-755522ca-29f5-4a16-b718-d66809dfc915 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:15.309567 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-755522ca-29f5-4a16-b718-d66809dfc915 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:15.310012 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-755522ca-29f5-4a16-b718-d66809dfc915 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:15.310811 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-755522ca-29f5-4a16-b718-d66809dfc915 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:15.311238 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-755522ca-29f5-4a16-b718-d66809dfc915 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:15.412032 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5011f466-9cc8-44d4-b248-a2c65e0159aa tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:15.415048 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-5011f466-9cc8-44d4-b248-a2c65e0159aa tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.189128 Jul 13 21:05:15.415797 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 66/125] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:15 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:15.472598 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-755522ca-29f5-4a16-b718-d66809dfc915 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:15.481042 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-755522ca-29f5-4a16-b718-d66809dfc915 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:15.482743 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-755522ca-29f5-4a16-b718-d66809dfc915 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:15.483930 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-755522ca-29f5-4a16-b718-d66809dfc915 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.187814 Jul 13 21:05:15.484608 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 60/126] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:15 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:15.947681 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-9a87ada2-1e59-4f5f-82ea-0961b171a572 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:15.948299 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-9a87ada2-1e59-4f5f-82ea-0961b171a572 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:15.954329 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9a87ada2-1e59-4f5f-82ea-0961b171a572 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:15.954821 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9a87ada2-1e59-4f5f-82ea-0961b171a572 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:15.955575 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9a87ada2-1e59-4f5f-82ea-0961b171a572 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:15.956004 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9a87ada2-1e59-4f5f-82ea-0961b171a572 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:16.160258 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-9a87ada2-1e59-4f5f-82ea-0961b171a572 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:16.179926 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-9a87ada2-1e59-4f5f-82ea-0961b171a572 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.231248 Jul 13 21:05:16.193470 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 67/127] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:15 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:16.314153 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-2e602f8b-4e0e-43a2-aa58-0497bd6a43d9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:16.314801 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-2e602f8b-4e0e-43a2-aa58-0497bd6a43d9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:16.321811 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2e602f8b-4e0e-43a2-aa58-0497bd6a43d9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:16.322266 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2e602f8b-4e0e-43a2-aa58-0497bd6a43d9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:16.323144 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2e602f8b-4e0e-43a2-aa58-0497bd6a43d9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:16.333970 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2e602f8b-4e0e-43a2-aa58-0497bd6a43d9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:16.432336 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-e8864bbd-22f2-4a80-86e8-8aceab6ec842 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:16.432944 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-e8864bbd-22f2-4a80-86e8-8aceab6ec842 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:16.444276 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e8864bbd-22f2-4a80-86e8-8aceab6ec842 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:16.444754 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e8864bbd-22f2-4a80-86e8-8aceab6ec842 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:16.445560 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e8864bbd-22f2-4a80-86e8-8aceab6ec842 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:16.445976 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e8864bbd-22f2-4a80-86e8-8aceab6ec842 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:16.749180 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-e8864bbd-22f2-4a80-86e8-8aceab6ec842 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:16.757990 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-e8864bbd-22f2-4a80-86e8-8aceab6ec842 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.329304 Jul 13 21:05:16.767623 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 68/128] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:16 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:16.767623 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-5bc98d18-fa11-4e9b-a8df-4ce4923a6bc2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:16.767623 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-5bc98d18-fa11-4e9b-a8df-4ce4923a6bc2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:16.770706 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5bc98d18-fa11-4e9b-a8df-4ce4923a6bc2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:16.771505 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5bc98d18-fa11-4e9b-a8df-4ce4923a6bc2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:16.772835 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5bc98d18-fa11-4e9b-a8df-4ce4923a6bc2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:16.773613 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5bc98d18-fa11-4e9b-a8df-4ce4923a6bc2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:17.013809 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5bc98d18-fa11-4e9b-a8df-4ce4923a6bc2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:17.027689 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5bc98d18-fa11-4e9b-a8df-4ce4923a6bc2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:17.030144 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5bc98d18-fa11-4e9b-a8df-4ce4923a6bc2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:17.031413 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-5bc98d18-fa11-4e9b-a8df-4ce4923a6bc2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.271760 Jul 13 21:05:17.032513 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 69/129] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:16 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:17.093626 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-2e602f8b-4e0e-43a2-aa58-0497bd6a43d9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:17.101692 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-2e602f8b-4e0e-43a2-aa58-0497bd6a43d9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.791501 Jul 13 21:05:17.102266 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 61/130] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:16 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:17.201411 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-4c005162-8983-45e1-829f-526fe3ad1784 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:17.202516 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-4c005162-8983-45e1-829f-526fe3ad1784 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:17.214570 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4c005162-8983-45e1-829f-526fe3ad1784 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:17.216557 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4c005162-8983-45e1-829f-526fe3ad1784 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:17.218284 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4c005162-8983-45e1-829f-526fe3ad1784 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:17.219091 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4c005162-8983-45e1-829f-526fe3ad1784 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:17.694275 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-1b700be7-ac73-4768-ab08-8726b6716a41 req-72cd9663-fc35-4b9c-846f-69ec0e700624 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52701d54-bab0-4fd7-b5c1-1b0e433d4c9f", "tag": "38f6480c-0bdd-4309-9b91-2e38a86a5d27"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:05:17.730597 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-4c005162-8983-45e1-829f-526fe3ad1784 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:17.733980 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-1b700be7-ac73-4768-ab08-8726b6716a41 req-72cd9663-fc35-4b9c-846f-69ec0e700624 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:17.736237 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-1b700be7-ac73-4768-ab08-8726b6716a41 req-72cd9663-fc35-4b9c-846f-69ec0e700624 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:17.744148 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-4c005162-8983-45e1-829f-526fe3ad1784 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.547360 Jul 13 21:05:17.758960 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 70/131] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:17 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:17.775512 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-3ffe187d-8a3e-4f4b-818e-2c36e101026b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:17.776545 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-3ffe187d-8a3e-4f4b-818e-2c36e101026b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:17.800351 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3ffe187d-8a3e-4f4b-818e-2c36e101026b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:17.800761 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3ffe187d-8a3e-4f4b-818e-2c36e101026b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:17.802079 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3ffe187d-8a3e-4f4b-818e-2c36e101026b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:17.802513 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3ffe187d-8a3e-4f4b-818e-2c36e101026b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:17.818276 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-1b700be7-ac73-4768-ab08-8726b6716a41 req-72cd9663-fc35-4b9c-846f-69ec0e700624 service nova] Creating event network-changed:38f6480c-0bdd-4309-9b91-2e38a86a5d27 for instance 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f on hv-cinder-79987 Jul 13 21:05:17.818866 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-1b700be7-ac73-4768-ab08-8726b6716a41 req-72cd9663-fc35-4b9c-846f-69ec0e700624 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 13 21:05:17.824123 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1f9fbe0e-819d-4a18-8071-9371c338e764 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:17.824220 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1f9fbe0e-819d-4a18-8071-9371c338e764 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:17.824951 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1f9fbe0e-819d-4a18-8071-9371c338e764 None None] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:17.825381 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1f9fbe0e-819d-4a18-8071-9371c338e764 None None] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:17.866578 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.compute.rpcapi [None req-1f9fbe0e-819d-4a18-8071-9371c338e764 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 13 21:05:17.890163 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1f9fbe0e-819d-4a18-8071-9371c338e764 None None] Releasing lock "compute-rpcapi-router" {{(pid=118444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 13 21:05:17.936455 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-1f9fbe0e-819d-4a18-8071-9371c338e764 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.425545 Jul 13 21:05:17.937366 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 62/132] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:05:18.050977 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-e7c3f8c2-8279-40fb-9539-ef58602627de tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:18.052604 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-e7c3f8c2-8279-40fb-9539-ef58602627de tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:18.067733 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e7c3f8c2-8279-40fb-9539-ef58602627de tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:18.068279 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e7c3f8c2-8279-40fb-9539-ef58602627de tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:18.069235 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e7c3f8c2-8279-40fb-9539-ef58602627de tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:18.069843 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e7c3f8c2-8279-40fb-9539-ef58602627de tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:18.267555 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3ffe187d-8a3e-4f4b-818e-2c36e101026b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:18.276065 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-3ffe187d-8a3e-4f4b-818e-2c36e101026b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.504703 Jul 13 21:05:18.289626 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 71/133] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:17 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:18.289996 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-9ff44d29-4702-4ae3-9090-f438f92e57a7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:18.291808 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-9ff44d29-4702-4ae3-9090-f438f92e57a7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:18.304258 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9ff44d29-4702-4ae3-9090-f438f92e57a7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:18.304936 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9ff44d29-4702-4ae3-9090-f438f92e57a7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:18.305924 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9ff44d29-4702-4ae3-9090-f438f92e57a7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:18.306553 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9ff44d29-4702-4ae3-9090-f438f92e57a7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:18.496572 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-9ff44d29-4702-4ae3-9090-f438f92e57a7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:18.501463 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-e7c3f8c2-8279-40fb-9539-ef58602627de tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:18.509500 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-9ff44d29-4702-4ae3-9090-f438f92e57a7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.226085 Jul 13 21:05:18.509863 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-e7c3f8c2-8279-40fb-9539-ef58602627de tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:18.510280 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 72/134] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:18 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:18.511987 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-e7c3f8c2-8279-40fb-9539-ef58602627de tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:18.513192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-e7c3f8c2-8279-40fb-9539-ef58602627de tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.467092 Jul 13 21:05:18.514005 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 63/135] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:18 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:18.761810 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-03291b68-9596-4a5d-ac71-57fe68175ce0 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:18.763158 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-03291b68-9596-4a5d-ac71-57fe68175ce0 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:18.772651 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-03291b68-9596-4a5d-ac71-57fe68175ce0 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:18.773113 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-03291b68-9596-4a5d-ac71-57fe68175ce0 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:18.773896 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-03291b68-9596-4a5d-ac71-57fe68175ce0 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:18.774578 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-03291b68-9596-4a5d-ac71-57fe68175ce0 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:18.826556 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-7f244435-2a83-4f5f-aaaf-54690c3407f5 req-e010958c-34f3-4011-a77c-49b9ae3d6c04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ed35cd9-7632-4570-b17d-c08b19ed09d8", "tag": "2fcd8530-2884-4c9c-a739-6fbe50c8a3ff"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:05:18.841680 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-7f244435-2a83-4f5f-aaaf-54690c3407f5 req-e010958c-34f3-4011-a77c-49b9ae3d6c04 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:18.842524 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-7f244435-2a83-4f5f-aaaf-54690c3407f5 req-e010958c-34f3-4011-a77c-49b9ae3d6c04 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:18.883777 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-7f244435-2a83-4f5f-aaaf-54690c3407f5 req-e010958c-34f3-4011-a77c-49b9ae3d6c04 service nova] Creating event network-changed:2fcd8530-2884-4c9c-a739-6fbe50c8a3ff for instance 8ed35cd9-7632-4570-b17d-c08b19ed09d8 on hv-cinder-79987 Jul 13 21:05:18.884872 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-7f244435-2a83-4f5f-aaaf-54690c3407f5 req-e010958c-34f3-4011-a77c-49b9ae3d6c04 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118445) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 13 21:05:18.886470 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5cdec217-f9f8-4ad2-96d3-014e2aa0a851 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:18.887200 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5cdec217-f9f8-4ad2-96d3-014e2aa0a851 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:18.889374 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5cdec217-f9f8-4ad2-96d3-014e2aa0a851 None None] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:18.890349 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5cdec217-f9f8-4ad2-96d3-014e2aa0a851 None None] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:18.922417 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.compute.rpcapi [None req-5cdec217-f9f8-4ad2-96d3-014e2aa0a851 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 13 21:05:18.925726 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5cdec217-f9f8-4ad2-96d3-014e2aa0a851 None None] Releasing lock "compute-rpcapi-router" {{(pid=118445) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 13 21:05:18.988428 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-5cdec217-f9f8-4ad2-96d3-014e2aa0a851 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.257456 Jul 13 21:05:18.990922 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 73/136] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:05:19.106338 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-03291b68-9596-4a5d-ac71-57fe68175ce0 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:19.116411 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-03291b68-9596-4a5d-ac71-57fe68175ce0 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.358695 Jul 13 21:05:19.123590 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 64/137] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:18 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:19.296759 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-a74e5613-2d68-4b8d-8677-b961d973cc5c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:19.297442 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-a74e5613-2d68-4b8d-8677-b961d973cc5c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:19.306815 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a74e5613-2d68-4b8d-8677-b961d973cc5c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:19.306815 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a74e5613-2d68-4b8d-8677-b961d973cc5c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:19.306815 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a74e5613-2d68-4b8d-8677-b961d973cc5c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:19.307166 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a74e5613-2d68-4b8d-8677-b961d973cc5c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:19.437783 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-a74e5613-2d68-4b8d-8677-b961d973cc5c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:19.445855 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-a74e5613-2d68-4b8d-8677-b961d973cc5c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.153318 Jul 13 21:05:19.446411 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 74/138] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:19 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:19.526959 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-332c0879-ebed-4409-ad88-acfd4e0176f7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:19.527723 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-332c0879-ebed-4409-ad88-acfd4e0176f7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:19.532491 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-d12c0953-161a-4943-8cfe-99842e5d6db8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:19.536512 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-d12c0953-161a-4943-8cfe-99842e5d6db8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:19.536595 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-332c0879-ebed-4409-ad88-acfd4e0176f7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:19.536986 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-332c0879-ebed-4409-ad88-acfd4e0176f7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:19.537747 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-332c0879-ebed-4409-ad88-acfd4e0176f7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:19.538247 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-332c0879-ebed-4409-ad88-acfd4e0176f7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:19.540214 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d12c0953-161a-4943-8cfe-99842e5d6db8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:19.540661 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d12c0953-161a-4943-8cfe-99842e5d6db8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:19.541419 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d12c0953-161a-4943-8cfe-99842e5d6db8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:19.541846 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d12c0953-161a-4943-8cfe-99842e5d6db8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:19.666663 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-332c0879-ebed-4409-ad88-acfd4e0176f7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:19.674015 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-332c0879-ebed-4409-ad88-acfd4e0176f7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.151286 Jul 13 21:05:19.674581 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 65/139] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:19 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:19.680244 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-d12c0953-161a-4943-8cfe-99842e5d6db8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:19.688265 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-d12c0953-161a-4943-8cfe-99842e5d6db8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:19.689755 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-d12c0953-161a-4943-8cfe-99842e5d6db8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:19.690898 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-d12c0953-161a-4943-8cfe-99842e5d6db8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.162836 Jul 13 21:05:19.691450 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 75/140] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:19 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:05:20.141095 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-fbabdb28-acf2-45db-aca0-37d92637d3ce tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:20.141701 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-fbabdb28-acf2-45db-aca0-37d92637d3ce tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:20.148259 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fbabdb28-acf2-45db-aca0-37d92637d3ce tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:20.148712 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fbabdb28-acf2-45db-aca0-37d92637d3ce tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:20.149720 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fbabdb28-acf2-45db-aca0-37d92637d3ce tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:20.150164 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fbabdb28-acf2-45db-aca0-37d92637d3ce tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:20.284287 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-fbabdb28-acf2-45db-aca0-37d92637d3ce tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:20.291714 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-fbabdb28-acf2-45db-aca0-37d92637d3ce tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.154397 Jul 13 21:05:20.292283 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 66/141] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:20 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:20.463195 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-bf8142a1-49a2-485f-998b-a84c1971cd5f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:20.463799 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-bf8142a1-49a2-485f-998b-a84c1971cd5f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:20.469921 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bf8142a1-49a2-485f-998b-a84c1971cd5f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:20.470357 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bf8142a1-49a2-485f-998b-a84c1971cd5f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:20.471224 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bf8142a1-49a2-485f-998b-a84c1971cd5f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:20.471672 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bf8142a1-49a2-485f-998b-a84c1971cd5f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:20.593992 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-bf8142a1-49a2-485f-998b-a84c1971cd5f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:20.601264 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-bf8142a1-49a2-485f-998b-a84c1971cd5f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.141790 Jul 13 21:05:20.601825 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 76/142] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:20 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:20.690319 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-6b472903-b417-41e2-8a51-eb43acbe428f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:20.690890 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-6b472903-b417-41e2-8a51-eb43acbe428f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:20.697488 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6b472903-b417-41e2-8a51-eb43acbe428f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:20.697930 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6b472903-b417-41e2-8a51-eb43acbe428f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:20.698696 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6b472903-b417-41e2-8a51-eb43acbe428f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:20.699129 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6b472903-b417-41e2-8a51-eb43acbe428f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:20.709165 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-b73943ca-da54-4cc1-90e2-57b772243ffa tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:20.709768 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-b73943ca-da54-4cc1-90e2-57b772243ffa tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:20.715612 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b73943ca-da54-4cc1-90e2-57b772243ffa tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:20.716049 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b73943ca-da54-4cc1-90e2-57b772243ffa tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:20.716786 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b73943ca-da54-4cc1-90e2-57b772243ffa tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:20.717211 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b73943ca-da54-4cc1-90e2-57b772243ffa tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:20.830504 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-6b472903-b417-41e2-8a51-eb43acbe428f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:20.837842 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-6b472903-b417-41e2-8a51-eb43acbe428f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.151266 Jul 13 21:05:20.838410 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 67/143] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:20 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:20.845570 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b73943ca-da54-4cc1-90e2-57b772243ffa tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:20.853430 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b73943ca-da54-4cc1-90e2-57b772243ffa tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:20.855011 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b73943ca-da54-4cc1-90e2-57b772243ffa tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:20.856089 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-b73943ca-da54-4cc1-90e2-57b772243ffa tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.150861 Jul 13 21:05:20.856630 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 77/144] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:20 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:21.011677 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-059ea7c0-7a56-4b52-9fa5-3553a801b2ee req-d83baed3-7f7a-4704-8326-f84b08587b9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcbf4753-6006-45d1-af09-33b6f6047153", "tag": "f4a4aa3a-af10-49d3-b754-e5211cb6004b"}, {"name": "network-changed", "server_uuid": "12316d28-2975-4c1e-b05b-82a3253bb35f", "tag": "8d927002-4a46-4df8-b48a-c6cb84decd8d"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:05:21.020346 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-059ea7c0-7a56-4b52-9fa5-3553a801b2ee req-d83baed3-7f7a-4704-8326-f84b08587b9d service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:21.020776 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-059ea7c0-7a56-4b52-9fa5-3553a801b2ee req-d83baed3-7f7a-4704-8326-f84b08587b9d service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:21.032854 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-059ea7c0-7a56-4b52-9fa5-3553a801b2ee req-d83baed3-7f7a-4704-8326-f84b08587b9d service nova] Creating event network-changed:f4a4aa3a-af10-49d3-b754-e5211cb6004b for instance bcbf4753-6006-45d1-af09-33b6f6047153 on hv-cinder-79987 Jul 13 21:05:21.033344 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-059ea7c0-7a56-4b52-9fa5-3553a801b2ee req-d83baed3-7f7a-4704-8326-f84b08587b9d service nova] Creating event network-changed:8d927002-4a46-4df8-b48a-c6cb84decd8d for instance 12316d28-2975-4c1e-b05b-82a3253bb35f on hv-cinder-79987 Jul 13 21:05:21.040067 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-059ea7c0-7a56-4b52-9fa5-3553a801b2ee req-d83baed3-7f7a-4704-8326-f84b08587b9d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.031919 Jul 13 21:05:21.040636 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 68/145] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:05:21.308303 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-679caad4-d0b8-4c54-9775-d340f11abeeb tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:21.308905 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-679caad4-d0b8-4c54-9775-d340f11abeeb tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:21.314859 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-679caad4-d0b8-4c54-9775-d340f11abeeb tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:21.315301 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-679caad4-d0b8-4c54-9775-d340f11abeeb tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:21.316043 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-679caad4-d0b8-4c54-9775-d340f11abeeb tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:21.316471 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-679caad4-d0b8-4c54-9775-d340f11abeeb tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:21.333924 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=100 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:05:21.441846 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-679caad4-d0b8-4c54-9775-d340f11abeeb tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:21.449291 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-679caad4-d0b8-4c54-9775-d340f11abeeb tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.144699 Jul 13 21:05:21.449846 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 78/146] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:21 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:21.618102 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-99eda0a3-8932-43b2-859a-5b5332565321 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:21.618821 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-99eda0a3-8932-43b2-859a-5b5332565321 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:21.625052 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-99eda0a3-8932-43b2-859a-5b5332565321 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:21.625496 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-99eda0a3-8932-43b2-859a-5b5332565321 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:21.626240 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-99eda0a3-8932-43b2-859a-5b5332565321 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:21.626695 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-99eda0a3-8932-43b2-859a-5b5332565321 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:21.758459 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-99eda0a3-8932-43b2-859a-5b5332565321 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:21.765688 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-99eda0a3-8932-43b2-859a-5b5332565321 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.151724 Jul 13 21:05:21.766241 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 69/147] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:21 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:21.854318 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-14add78e-ca03-4849-8c4d-dbfa34e4f189 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:21.854975 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-14add78e-ca03-4849-8c4d-dbfa34e4f189 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:21.860891 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-14add78e-ca03-4849-8c4d-dbfa34e4f189 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:21.861327 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-14add78e-ca03-4849-8c4d-dbfa34e4f189 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:21.862076 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-14add78e-ca03-4849-8c4d-dbfa34e4f189 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:21.862502 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-14add78e-ca03-4849-8c4d-dbfa34e4f189 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:21.874230 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-8faa6280-c2c5-473e-90bb-5a45380882bc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:21.874860 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-8faa6280-c2c5-473e-90bb-5a45380882bc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:21.881347 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8faa6280-c2c5-473e-90bb-5a45380882bc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:21.881783 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8faa6280-c2c5-473e-90bb-5a45380882bc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:21.882520 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8faa6280-c2c5-473e-90bb-5a45380882bc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:21.882967 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8faa6280-c2c5-473e-90bb-5a45380882bc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:21.995703 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-14add78e-ca03-4849-8c4d-dbfa34e4f189 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:22.003152 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-14add78e-ca03-4849-8c4d-dbfa34e4f189 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.152572 Jul 13 21:05:22.003746 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 79/148] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:21 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:22.014956 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-8faa6280-c2c5-473e-90bb-5a45380882bc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:22.023272 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-8faa6280-c2c5-473e-90bb-5a45380882bc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:22.025040 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-8faa6280-c2c5-473e-90bb-5a45380882bc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:22.026115 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-8faa6280-c2c5-473e-90bb-5a45380882bc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.155741 Jul 13 21:05:22.026682 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 70/149] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:21 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:05:22.466502 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-3b3e5394-a179-4107-9439-783ff75fb99a tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:22.467132 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-3b3e5394-a179-4107-9439-783ff75fb99a tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:22.473769 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3b3e5394-a179-4107-9439-783ff75fb99a tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:22.474267 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3b3e5394-a179-4107-9439-783ff75fb99a tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:22.475039 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3b3e5394-a179-4107-9439-783ff75fb99a tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:22.475385 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3b3e5394-a179-4107-9439-783ff75fb99a tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:22.603827 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3b3e5394-a179-4107-9439-783ff75fb99a tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:22.611158 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-3b3e5394-a179-4107-9439-783ff75fb99a tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.148532 Jul 13 21:05:22.611714 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 80/150] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:22 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:22.782362 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ad85bc51-fb35-4d1b-93e5-9443878b4acf tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:22.782997 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-ad85bc51-fb35-4d1b-93e5-9443878b4acf tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:22.789480 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ad85bc51-fb35-4d1b-93e5-9443878b4acf tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:22.789929 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ad85bc51-fb35-4d1b-93e5-9443878b4acf tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:22.790710 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ad85bc51-fb35-4d1b-93e5-9443878b4acf tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:22.791145 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ad85bc51-fb35-4d1b-93e5-9443878b4acf tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:22.914590 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ad85bc51-fb35-4d1b-93e5-9443878b4acf tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:22.921879 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ad85bc51-fb35-4d1b-93e5-9443878b4acf tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.143259 Jul 13 21:05:22.922448 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 71/151] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:22 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:23.020792 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-5b834ca5-11b2-497f-8aae-36369ec01823 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:23.021394 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-5b834ca5-11b2-497f-8aae-36369ec01823 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:23.027595 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5b834ca5-11b2-497f-8aae-36369ec01823 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:23.028036 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5b834ca5-11b2-497f-8aae-36369ec01823 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:23.028787 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5b834ca5-11b2-497f-8aae-36369ec01823 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:23.029213 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5b834ca5-11b2-497f-8aae-36369ec01823 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:23.043823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-03e2ebc7-ce4e-4b68-9e62-2eec5082fa8b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:23.044431 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-03e2ebc7-ce4e-4b68-9e62-2eec5082fa8b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:23.050321 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-03e2ebc7-ce4e-4b68-9e62-2eec5082fa8b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:23.050805 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-03e2ebc7-ce4e-4b68-9e62-2eec5082fa8b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:23.051557 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-03e2ebc7-ce4e-4b68-9e62-2eec5082fa8b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:23.051994 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-03e2ebc7-ce4e-4b68-9e62-2eec5082fa8b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:23.159373 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5b834ca5-11b2-497f-8aae-36369ec01823 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:23.167320 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-5b834ca5-11b2-497f-8aae-36369ec01823 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.150818 Jul 13 21:05:23.167894 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 81/152] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:23 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:23.183859 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-03e2ebc7-ce4e-4b68-9e62-2eec5082fa8b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:23.191700 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-03e2ebc7-ce4e-4b68-9e62-2eec5082fa8b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:23.193188 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-03e2ebc7-ce4e-4b68-9e62-2eec5082fa8b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:23.194279 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-03e2ebc7-ce4e-4b68-9e62-2eec5082fa8b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.154316 Jul 13 21:05:23.194861 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 72/153] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:23 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:05:23.628622 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-7b972f48-a68d-475f-bfce-c82fd6f8a469 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:23.629908 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-7b972f48-a68d-475f-bfce-c82fd6f8a469 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:23.635921 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7b972f48-a68d-475f-bfce-c82fd6f8a469 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:23.636368 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7b972f48-a68d-475f-bfce-c82fd6f8a469 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:23.637125 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7b972f48-a68d-475f-bfce-c82fd6f8a469 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:23.637555 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7b972f48-a68d-475f-bfce-c82fd6f8a469 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:23.770592 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-7b972f48-a68d-475f-bfce-c82fd6f8a469 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:23.778305 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-7b972f48-a68d-475f-bfce-c82fd6f8a469 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.153651 Jul 13 21:05:23.778892 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 82/154] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:23 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:23.938424 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-91573154-16a6-46ab-a702-de292f59c154 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:23.939048 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-91573154-16a6-46ab-a702-de292f59c154 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:23.945770 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-91573154-16a6-46ab-a702-de292f59c154 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:23.946212 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-91573154-16a6-46ab-a702-de292f59c154 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:23.946994 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-91573154-16a6-46ab-a702-de292f59c154 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:23.947418 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-91573154-16a6-46ab-a702-de292f59c154 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:23.951445 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=100 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:05:24.071944 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-91573154-16a6-46ab-a702-de292f59c154 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:24.079274 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-91573154-16a6-46ab-a702-de292f59c154 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.144614 Jul 13 21:05:24.079829 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 73/155] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:23 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:24.183631 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-94cd178d-4134-4533-a12e-b8dd84686b75 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:24.184239 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-94cd178d-4134-4533-a12e-b8dd84686b75 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:24.190283 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-94cd178d-4134-4533-a12e-b8dd84686b75 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:24.190710 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-94cd178d-4134-4533-a12e-b8dd84686b75 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:24.191467 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-94cd178d-4134-4533-a12e-b8dd84686b75 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:24.191900 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-94cd178d-4134-4533-a12e-b8dd84686b75 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:24.211498 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-2c460a71-0d74-4b29-b5c3-b45f41a0182e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:24.212089 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-2c460a71-0d74-4b29-b5c3-b45f41a0182e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:24.217896 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2c460a71-0d74-4b29-b5c3-b45f41a0182e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:24.218335 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2c460a71-0d74-4b29-b5c3-b45f41a0182e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:24.219126 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2c460a71-0d74-4b29-b5c3-b45f41a0182e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:24.219549 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2c460a71-0d74-4b29-b5c3-b45f41a0182e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:24.324874 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-94cd178d-4134-4533-a12e-b8dd84686b75 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:24.335378 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-94cd178d-4134-4533-a12e-b8dd84686b75 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.155450 Jul 13 21:05:24.336165 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 83/156] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:24 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:24.368547 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-2c460a71-0d74-4b29-b5c3-b45f41a0182e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:24.379631 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-2c460a71-0d74-4b29-b5c3-b45f41a0182e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:24.381351 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-2c460a71-0d74-4b29-b5c3-b45f41a0182e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:24.382896 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-2c460a71-0d74-4b29-b5c3-b45f41a0182e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.175258 Jul 13 21:05:24.386669 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 74/157] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:24 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:05:24.799722 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-8a3f3f33-b5db-4475-8b27-a6768e683963 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:24.800411 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8a3f3f33-b5db-4475-8b27-a6768e683963 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:24.808633 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8a3f3f33-b5db-4475-8b27-a6768e683963 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:24.809150 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8a3f3f33-b5db-4475-8b27-a6768e683963 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:24.809985 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8a3f3f33-b5db-4475-8b27-a6768e683963 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:24.810488 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8a3f3f33-b5db-4475-8b27-a6768e683963 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:24.959685 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8a3f3f33-b5db-4475-8b27-a6768e683963 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:24.967373 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-8a3f3f33-b5db-4475-8b27-a6768e683963 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.175943 Jul 13 21:05:24.967939 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 84/158] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:24 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:25.095762 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-f425e9bc-25fe-4c66-9a05-6c05d761da17 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:25.096403 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-f425e9bc-25fe-4c66-9a05-6c05d761da17 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:25.102420 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f425e9bc-25fe-4c66-9a05-6c05d761da17 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:25.102900 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f425e9bc-25fe-4c66-9a05-6c05d761da17 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:25.103654 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f425e9bc-25fe-4c66-9a05-6c05d761da17 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:25.104085 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f425e9bc-25fe-4c66-9a05-6c05d761da17 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:25.230486 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f425e9bc-25fe-4c66-9a05-6c05d761da17 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:25.237798 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-f425e9bc-25fe-4c66-9a05-6c05d761da17 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.145841 Jul 13 21:05:25.238864 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 75/159] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:25 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:25.352015 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-07664642-07d6-40fe-a2b2-b2c1cf014446 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:25.352613 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-07664642-07d6-40fe-a2b2-b2c1cf014446 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:25.358689 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-07664642-07d6-40fe-a2b2-b2c1cf014446 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:25.359127 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-07664642-07d6-40fe-a2b2-b2c1cf014446 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:25.359862 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-07664642-07d6-40fe-a2b2-b2c1cf014446 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:25.360285 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-07664642-07d6-40fe-a2b2-b2c1cf014446 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:25.401328 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-56797b59-2e91-4198-b709-22c6ca9492c1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:25.405560 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-56797b59-2e91-4198-b709-22c6ca9492c1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:25.408093 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-56797b59-2e91-4198-b709-22c6ca9492c1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:25.408544 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-56797b59-2e91-4198-b709-22c6ca9492c1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:25.409330 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-56797b59-2e91-4198-b709-22c6ca9492c1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:25.409969 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-56797b59-2e91-4198-b709-22c6ca9492c1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:25.489936 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-07664642-07d6-40fe-a2b2-b2c1cf014446 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:25.497582 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-07664642-07d6-40fe-a2b2-b2c1cf014446 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.149299 Jul 13 21:05:25.498144 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 85/160] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:25 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:25.536325 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-56797b59-2e91-4198-b709-22c6ca9492c1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:25.544307 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-56797b59-2e91-4198-b709-22c6ca9492c1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:25.545860 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-56797b59-2e91-4198-b709-22c6ca9492c1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:25.546992 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-56797b59-2e91-4198-b709-22c6ca9492c1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.149658 Jul 13 21:05:25.547560 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 76/161] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:25 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:05:25.984510 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-6693da7e-0cc0-493b-b4d0-fbc2f5a7e412 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:25.985102 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-6693da7e-0cc0-493b-b4d0-fbc2f5a7e412 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:25.991232 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6693da7e-0cc0-493b-b4d0-fbc2f5a7e412 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:25.991672 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6693da7e-0cc0-493b-b4d0-fbc2f5a7e412 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:25.992416 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6693da7e-0cc0-493b-b4d0-fbc2f5a7e412 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:25.992841 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6693da7e-0cc0-493b-b4d0-fbc2f5a7e412 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:26.120855 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-6693da7e-0cc0-493b-b4d0-fbc2f5a7e412 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:26.128160 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-6693da7e-0cc0-493b-b4d0-fbc2f5a7e412 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.147646 Jul 13 21:05:26.128708 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 86/162] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:25 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:26.255014 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-94da4d80-bbc8-4b0d-9480-3a076b21b799 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:26.255619 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-94da4d80-bbc8-4b0d-9480-3a076b21b799 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:26.261769 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-94da4d80-bbc8-4b0d-9480-3a076b21b799 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:26.262211 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-94da4d80-bbc8-4b0d-9480-3a076b21b799 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:26.262985 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-94da4d80-bbc8-4b0d-9480-3a076b21b799 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:26.263411 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-94da4d80-bbc8-4b0d-9480-3a076b21b799 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:26.390082 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-94da4d80-bbc8-4b0d-9480-3a076b21b799 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:26.397885 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-94da4d80-bbc8-4b0d-9480-3a076b21b799 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.147273 Jul 13 21:05:26.398447 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 77/163] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:26 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:26.513061 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-eb646b1e-ee80-48fb-ba6e-7e31bd577554 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:26.513665 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-eb646b1e-ee80-48fb-ba6e-7e31bd577554 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:26.520451 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-eb646b1e-ee80-48fb-ba6e-7e31bd577554 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:26.520893 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-eb646b1e-ee80-48fb-ba6e-7e31bd577554 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:26.521646 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-eb646b1e-ee80-48fb-ba6e-7e31bd577554 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:26.522072 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-eb646b1e-ee80-48fb-ba6e-7e31bd577554 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:26.565087 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-43f2629a-19c2-4d18-abc7-2cf8b7d41413 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:26.565684 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-43f2629a-19c2-4d18-abc7-2cf8b7d41413 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:26.572136 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-43f2629a-19c2-4d18-abc7-2cf8b7d41413 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:26.572581 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-43f2629a-19c2-4d18-abc7-2cf8b7d41413 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:26.573334 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-43f2629a-19c2-4d18-abc7-2cf8b7d41413 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:26.573761 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-43f2629a-19c2-4d18-abc7-2cf8b7d41413 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:26.651799 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-eb646b1e-ee80-48fb-ba6e-7e31bd577554 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:26.659328 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-eb646b1e-ee80-48fb-ba6e-7e31bd577554 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.150053 Jul 13 21:05:26.659978 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 87/164] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:26 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:26.700664 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-43f2629a-19c2-4d18-abc7-2cf8b7d41413 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:26.708583 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-43f2629a-19c2-4d18-abc7-2cf8b7d41413 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:26.710082 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-43f2629a-19c2-4d18-abc7-2cf8b7d41413 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:26.711207 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-43f2629a-19c2-4d18-abc7-2cf8b7d41413 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.149978 Jul 13 21:05:26.711758 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 78/165] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:26 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:05:27.144863 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-6bdaebed-bd69-49fe-9dce-a5ba54b3a145 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:27.145497 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-6bdaebed-bd69-49fe-9dce-a5ba54b3a145 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:27.151753 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6bdaebed-bd69-49fe-9dce-a5ba54b3a145 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:27.152205 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6bdaebed-bd69-49fe-9dce-a5ba54b3a145 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:27.152964 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6bdaebed-bd69-49fe-9dce-a5ba54b3a145 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:27.153395 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6bdaebed-bd69-49fe-9dce-a5ba54b3a145 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:27.288499 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-6bdaebed-bd69-49fe-9dce-a5ba54b3a145 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:27.295829 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-6bdaebed-bd69-49fe-9dce-a5ba54b3a145 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.154739 Jul 13 21:05:27.296388 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 88/166] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:27 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:27.415408 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-21c66d79-b8d0-4cf0-86a9-a567832c626e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:27.416028 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-21c66d79-b8d0-4cf0-86a9-a567832c626e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:27.422132 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-21c66d79-b8d0-4cf0-86a9-a567832c626e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:27.422599 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-21c66d79-b8d0-4cf0-86a9-a567832c626e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:27.423387 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-21c66d79-b8d0-4cf0-86a9-a567832c626e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:27.423817 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-21c66d79-b8d0-4cf0-86a9-a567832c626e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:27.553857 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-21c66d79-b8d0-4cf0-86a9-a567832c626e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:27.561179 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-21c66d79-b8d0-4cf0-86a9-a567832c626e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.149618 Jul 13 21:05:27.561745 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 79/167] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:27 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:27.676043 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-aa7c6b97-45f6-42dc-80b7-16dfeba15b7b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:27.676686 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-aa7c6b97-45f6-42dc-80b7-16dfeba15b7b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:27.682590 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-aa7c6b97-45f6-42dc-80b7-16dfeba15b7b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:27.683063 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-aa7c6b97-45f6-42dc-80b7-16dfeba15b7b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:27.683846 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-aa7c6b97-45f6-42dc-80b7-16dfeba15b7b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:27.684277 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-aa7c6b97-45f6-42dc-80b7-16dfeba15b7b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:27.729181 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-7964b252-7aab-4fcc-8a90-ea4a1248a4d0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:27.729700 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-7964b252-7aab-4fcc-8a90-ea4a1248a4d0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:27.735945 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7964b252-7aab-4fcc-8a90-ea4a1248a4d0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:27.736393 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7964b252-7aab-4fcc-8a90-ea4a1248a4d0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:27.737142 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7964b252-7aab-4fcc-8a90-ea4a1248a4d0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:27.737578 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7964b252-7aab-4fcc-8a90-ea4a1248a4d0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:27.855789 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell0:SELECT=2 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:05:27.868524 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-7964b252-7aab-4fcc-8a90-ea4a1248a4d0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:27.876794 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-7964b252-7aab-4fcc-8a90-ea4a1248a4d0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:27.878281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-7964b252-7aab-4fcc-8a90-ea4a1248a4d0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:27.879942 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-7964b252-7aab-4fcc-8a90-ea4a1248a4d0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.154644 Jul 13 21:05:27.880506 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 80/168] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:27 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:05:27.952920 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-aa7c6b97-45f6-42dc-80b7-16dfeba15b7b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:27.961310 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-aa7c6b97-45f6-42dc-80b7-16dfeba15b7b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.289094 Jul 13 21:05:27.961874 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 89/169] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:27 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:28.313799 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ce0f0d6f-a865-4af9-8d9c-d142d7658b8f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:28.314402 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-ce0f0d6f-a865-4af9-8d9c-d142d7658b8f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:28.321090 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ce0f0d6f-a865-4af9-8d9c-d142d7658b8f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:28.321542 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ce0f0d6f-a865-4af9-8d9c-d142d7658b8f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:28.322294 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ce0f0d6f-a865-4af9-8d9c-d142d7658b8f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:28.322756 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ce0f0d6f-a865-4af9-8d9c-d142d7658b8f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:28.450885 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ce0f0d6f-a865-4af9-8d9c-d142d7658b8f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:28.458244 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ce0f0d6f-a865-4af9-8d9c-d142d7658b8f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.148303 Jul 13 21:05:28.458838 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 81/170] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:28 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:28.577224 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-92ef61fd-58bb-4326-b07b-0c4fbcea6dbb tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:28.577821 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-92ef61fd-58bb-4326-b07b-0c4fbcea6dbb tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:28.584241 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-92ef61fd-58bb-4326-b07b-0c4fbcea6dbb tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:28.584677 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-92ef61fd-58bb-4326-b07b-0c4fbcea6dbb tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:28.585418 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-92ef61fd-58bb-4326-b07b-0c4fbcea6dbb tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:28.585842 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-92ef61fd-58bb-4326-b07b-0c4fbcea6dbb tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:28.711626 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-92ef61fd-58bb-4326-b07b-0c4fbcea6dbb tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:28.718899 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-92ef61fd-58bb-4326-b07b-0c4fbcea6dbb tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.145479 Jul 13 21:05:28.719456 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 90/171] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:28 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:28.897639 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-080e8a18-8a2f-4625-8878-00953e131adb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:28.898285 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-080e8a18-8a2f-4625-8878-00953e131adb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:28.904435 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-080e8a18-8a2f-4625-8878-00953e131adb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:28.904878 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-080e8a18-8a2f-4625-8878-00953e131adb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:28.905620 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-080e8a18-8a2f-4625-8878-00953e131adb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:28.906047 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-080e8a18-8a2f-4625-8878-00953e131adb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:28.977496 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-53d491d9-1b15-440b-a01d-20b4f67f4ff6 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:28.978096 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-53d491d9-1b15-440b-a01d-20b4f67f4ff6 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:28.979947 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=2 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:05:28.985387 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-53d491d9-1b15-440b-a01d-20b4f67f4ff6 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:28.986241 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-53d491d9-1b15-440b-a01d-20b4f67f4ff6 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:28.986689 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-53d491d9-1b15-440b-a01d-20b4f67f4ff6 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:28.987038 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-53d491d9-1b15-440b-a01d-20b4f67f4ff6 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:29.034451 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-080e8a18-8a2f-4625-8878-00953e131adb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:29.043023 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-080e8a18-8a2f-4625-8878-00953e131adb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:29.044497 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-080e8a18-8a2f-4625-8878-00953e131adb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:29.045584 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-080e8a18-8a2f-4625-8878-00953e131adb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.152314 Jul 13 21:05:29.046131 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 82/172] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:28 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:29.120520 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-53d491d9-1b15-440b-a01d-20b4f67f4ff6 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:29.127864 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-53d491d9-1b15-440b-a01d-20b4f67f4ff6 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.154185 Jul 13 21:05:29.128427 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 91/173] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:28 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:29.475990 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-9908292b-9dde-4b02-b224-b89dd5295ff1 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:29.476505 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-9908292b-9dde-4b02-b224-b89dd5295ff1 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:29.482335 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9908292b-9dde-4b02-b224-b89dd5295ff1 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:29.482817 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9908292b-9dde-4b02-b224-b89dd5295ff1 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:29.483563 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9908292b-9dde-4b02-b224-b89dd5295ff1 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:29.483985 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9908292b-9dde-4b02-b224-b89dd5295ff1 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:29.622200 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-9908292b-9dde-4b02-b224-b89dd5295ff1 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:29.632144 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-9908292b-9dde-4b02-b224-b89dd5295ff1 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.160182 Jul 13 21:05:29.633241 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 83/174] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:29 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:29.736272 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c2351d52-2b37-4ce3-a40c-c497b93fe835 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:29.736980 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-c2351d52-2b37-4ce3-a40c-c497b93fe835 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:29.743407 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c2351d52-2b37-4ce3-a40c-c497b93fe835 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:29.744066 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c2351d52-2b37-4ce3-a40c-c497b93fe835 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:29.745028 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c2351d52-2b37-4ce3-a40c-c497b93fe835 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:29.745457 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c2351d52-2b37-4ce3-a40c-c497b93fe835 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:29.885221 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c2351d52-2b37-4ce3-a40c-c497b93fe835 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:29.893238 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-c2351d52-2b37-4ce3-a40c-c497b93fe835 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.160892 Jul 13 21:05:29.893838 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 92/175] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:29 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:30.063262 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-1514e9fd-35c6-4c3d-a188-fd025a9b7c95 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:30.064330 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-1514e9fd-35c6-4c3d-a188-fd025a9b7c95 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:30.072968 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1514e9fd-35c6-4c3d-a188-fd025a9b7c95 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:30.073778 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1514e9fd-35c6-4c3d-a188-fd025a9b7c95 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:30.075076 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1514e9fd-35c6-4c3d-a188-fd025a9b7c95 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:30.075906 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1514e9fd-35c6-4c3d-a188-fd025a9b7c95 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:30.144330 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-5678ed3c-24f4-4582-b98e-e537128faecb tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:30.145227 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-5678ed3c-24f4-4582-b98e-e537128faecb tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:30.152288 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_api:SELECT=100 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:05:30.153933 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5678ed3c-24f4-4582-b98e-e537128faecb tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:30.154644 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5678ed3c-24f4-4582-b98e-e537128faecb tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:30.155445 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5678ed3c-24f4-4582-b98e-e537128faecb tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:30.156047 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5678ed3c-24f4-4582-b98e-e537128faecb tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:30.247567 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-1514e9fd-35c6-4c3d-a188-fd025a9b7c95 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:30.256765 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-1514e9fd-35c6-4c3d-a188-fd025a9b7c95 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:30.258367 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-1514e9fd-35c6-4c3d-a188-fd025a9b7c95 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:30.259476 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-1514e9fd-35c6-4c3d-a188-fd025a9b7c95 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.200044 Jul 13 21:05:30.260241 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 84/176] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:30 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:30.303324 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5678ed3c-24f4-4582-b98e-e537128faecb tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:30.310565 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-5678ed3c-24f4-4582-b98e-e537128faecb tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.171016 Jul 13 21:05:30.311147 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 93/177] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:30 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:30.649824 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-df2b0fd9-25f1-4996-9d7d-193c2a4ce9db tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:30.650413 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-df2b0fd9-25f1-4996-9d7d-193c2a4ce9db tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:30.656389 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-df2b0fd9-25f1-4996-9d7d-193c2a4ce9db tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:30.656858 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-df2b0fd9-25f1-4996-9d7d-193c2a4ce9db tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:30.657597 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-df2b0fd9-25f1-4996-9d7d-193c2a4ce9db tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:30.658023 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-df2b0fd9-25f1-4996-9d7d-193c2a4ce9db tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:30.783065 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-df2b0fd9-25f1-4996-9d7d-193c2a4ce9db tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:30.790561 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-df2b0fd9-25f1-4996-9d7d-193c2a4ce9db tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.144767 Jul 13 21:05:30.791180 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 85/178] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:30 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:30.910525 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-2660e383-c564-42f9-8037-b83ce482fc5c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:30.911087 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-2660e383-c564-42f9-8037-b83ce482fc5c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:30.917041 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2660e383-c564-42f9-8037-b83ce482fc5c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:30.917477 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2660e383-c564-42f9-8037-b83ce482fc5c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:30.918219 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2660e383-c564-42f9-8037-b83ce482fc5c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:30.918663 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2660e383-c564-42f9-8037-b83ce482fc5c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:31.044081 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-2660e383-c564-42f9-8037-b83ce482fc5c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:31.051391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-2660e383-c564-42f9-8037-b83ce482fc5c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.144737 Jul 13 21:05:31.051939 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 94/179] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:30 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:31.277340 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-d7755d9b-9059-4a27-824f-57c607652bbf tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:31.278140 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-d7755d9b-9059-4a27-824f-57c607652bbf tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:31.284077 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d7755d9b-9059-4a27-824f-57c607652bbf tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:31.284515 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d7755d9b-9059-4a27-824f-57c607652bbf tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:31.285256 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d7755d9b-9059-4a27-824f-57c607652bbf tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:31.285713 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d7755d9b-9059-4a27-824f-57c607652bbf tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:31.327414 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-3c5b5595-dec6-43f2-8f86-4e735a8313f3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:31.328090 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-3c5b5595-dec6-43f2-8f86-4e735a8313f3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:31.334119 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3c5b5595-dec6-43f2-8f86-4e735a8313f3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:31.334642 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3c5b5595-dec6-43f2-8f86-4e735a8313f3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:31.335398 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3c5b5595-dec6-43f2-8f86-4e735a8313f3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:31.335825 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3c5b5595-dec6-43f2-8f86-4e735a8313f3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:31.339716 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=100 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:05:31.416780 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-d7755d9b-9059-4a27-824f-57c607652bbf tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:31.424910 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-d7755d9b-9059-4a27-824f-57c607652bbf tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:31.427033 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-d7755d9b-9059-4a27-824f-57c607652bbf tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:31.428216 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-d7755d9b-9059-4a27-824f-57c607652bbf tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.154962 Jul 13 21:05:31.428856 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 86/180] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:31 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:31.461926 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3c5b5595-dec6-43f2-8f86-4e735a8313f3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:31.469286 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-3c5b5595-dec6-43f2-8f86-4e735a8313f3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.145585 Jul 13 21:05:31.469839 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 95/181] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:31 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:31.807493 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-2b787859-25d3-4567-8eb8-dadbed0ce066 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:31.808097 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-2b787859-25d3-4567-8eb8-dadbed0ce066 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:31.814089 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2b787859-25d3-4567-8eb8-dadbed0ce066 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:31.814539 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2b787859-25d3-4567-8eb8-dadbed0ce066 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:31.815326 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2b787859-25d3-4567-8eb8-dadbed0ce066 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:31.815765 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2b787859-25d3-4567-8eb8-dadbed0ce066 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:31.940222 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-2b787859-25d3-4567-8eb8-dadbed0ce066 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:31.947630 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-2b787859-25d3-4567-8eb8-dadbed0ce066 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.143935 Jul 13 21:05:31.948189 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 87/182] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:31 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:32.068323 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-b521e613-ef16-456b-b52f-f91bf3b135f6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:32.068918 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-b521e613-ef16-456b-b52f-f91bf3b135f6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:32.075113 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b521e613-ef16-456b-b52f-f91bf3b135f6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:32.075547 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b521e613-ef16-456b-b52f-f91bf3b135f6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:32.076290 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b521e613-ef16-456b-b52f-f91bf3b135f6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:32.076713 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b521e613-ef16-456b-b52f-f91bf3b135f6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:32.205145 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b521e613-ef16-456b-b52f-f91bf3b135f6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:32.212844 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-b521e613-ef16-456b-b52f-f91bf3b135f6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.148740 Jul 13 21:05:32.213388 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 96/183] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:32 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:32.446423 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-3471d4c2-1307-4eb4-9744-772c0977ef4b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:32.447040 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-3471d4c2-1307-4eb4-9744-772c0977ef4b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:32.452891 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3471d4c2-1307-4eb4-9744-772c0977ef4b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:32.453329 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3471d4c2-1307-4eb4-9744-772c0977ef4b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:32.454068 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3471d4c2-1307-4eb4-9744-772c0977ef4b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:32.454487 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3471d4c2-1307-4eb4-9744-772c0977ef4b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:32.486312 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-e40d22cd-ca8f-4d42-9c0e-52f713e0ae07 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:32.487044 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-e40d22cd-ca8f-4d42-9c0e-52f713e0ae07 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:32.493104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e40d22cd-ca8f-4d42-9c0e-52f713e0ae07 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:32.493628 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e40d22cd-ca8f-4d42-9c0e-52f713e0ae07 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:32.494456 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e40d22cd-ca8f-4d42-9c0e-52f713e0ae07 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:32.494984 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e40d22cd-ca8f-4d42-9c0e-52f713e0ae07 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:32.580996 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-3471d4c2-1307-4eb4-9744-772c0977ef4b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:32.589991 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-3471d4c2-1307-4eb4-9744-772c0977ef4b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:32.591438 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-3471d4c2-1307-4eb4-9744-772c0977ef4b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:32.592515 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-3471d4c2-1307-4eb4-9744-772c0977ef4b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.149846 Jul 13 21:05:32.593302 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 88/184] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:32 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:32.622645 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-e40d22cd-ca8f-4d42-9c0e-52f713e0ae07 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:32.630589 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-e40d22cd-ca8f-4d42-9c0e-52f713e0ae07 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.148186 Jul 13 21:05:32.631157 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 97/185] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:32 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:32.964676 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-eaf926b6-cdf7-4905-96dc-1acf2f79ec94 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:32.965301 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-eaf926b6-cdf7-4905-96dc-1acf2f79ec94 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:32.971300 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eaf926b6-cdf7-4905-96dc-1acf2f79ec94 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:32.971742 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eaf926b6-cdf7-4905-96dc-1acf2f79ec94 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:32.973016 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eaf926b6-cdf7-4905-96dc-1acf2f79ec94 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:32.973442 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eaf926b6-cdf7-4905-96dc-1acf2f79ec94 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:33.099474 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-eaf926b6-cdf7-4905-96dc-1acf2f79ec94 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:33.102882 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=100 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:05:33.107640 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-eaf926b6-cdf7-4905-96dc-1acf2f79ec94 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.146689 Jul 13 21:05:33.108208 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 89/186] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:32 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:33.229293 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-b57bbbe5-af19-4672-b99e-7a93fcf422d0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:33.229901 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-b57bbbe5-af19-4672-b99e-7a93fcf422d0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:33.236047 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b57bbbe5-af19-4672-b99e-7a93fcf422d0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:33.236492 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b57bbbe5-af19-4672-b99e-7a93fcf422d0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:33.237242 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b57bbbe5-af19-4672-b99e-7a93fcf422d0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:33.237667 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b57bbbe5-af19-4672-b99e-7a93fcf422d0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:33.361830 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b57bbbe5-af19-4672-b99e-7a93fcf422d0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:33.369700 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-b57bbbe5-af19-4672-b99e-7a93fcf422d0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.144215 Jul 13 21:05:33.370253 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 98/187] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:33 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:33.610485 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-d504c797-7eb2-4f32-bc52-362b92733282 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:33.611118 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-d504c797-7eb2-4f32-bc52-362b92733282 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:33.617003 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d504c797-7eb2-4f32-bc52-362b92733282 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:33.617448 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d504c797-7eb2-4f32-bc52-362b92733282 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:33.618200 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d504c797-7eb2-4f32-bc52-362b92733282 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:33.618716 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d504c797-7eb2-4f32-bc52-362b92733282 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:33.647544 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-76cfa8a7-bf98-428b-8a34-b48d7636131d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:33.648250 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-76cfa8a7-bf98-428b-8a34-b48d7636131d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:33.654560 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-76cfa8a7-bf98-428b-8a34-b48d7636131d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:33.655163 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-76cfa8a7-bf98-428b-8a34-b48d7636131d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:33.655979 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-76cfa8a7-bf98-428b-8a34-b48d7636131d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:33.656485 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-76cfa8a7-bf98-428b-8a34-b48d7636131d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:33.906889 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-76cfa8a7-bf98-428b-8a34-b48d7636131d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:33.914282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-76cfa8a7-bf98-428b-8a34-b48d7636131d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.270940 Jul 13 21:05:33.915065 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 99/188] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:33 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:34.125196 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-6008a242-7923-41e1-89ea-6fcb7d6d9594 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:34.125973 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-6008a242-7923-41e1-89ea-6fcb7d6d9594 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:34.133172 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6008a242-7923-41e1-89ea-6fcb7d6d9594 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:34.133582 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6008a242-7923-41e1-89ea-6fcb7d6d9594 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:34.134335 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6008a242-7923-41e1-89ea-6fcb7d6d9594 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:34.134865 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6008a242-7923-41e1-89ea-6fcb7d6d9594 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:34.221783 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-d504c797-7eb2-4f32-bc52-362b92733282 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:34.233168 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-d504c797-7eb2-4f32-bc52-362b92733282 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:34.236009 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-d504c797-7eb2-4f32-bc52-362b92733282 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:34.238480 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-d504c797-7eb2-4f32-bc52-362b92733282 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.630753 Jul 13 21:05:34.239666 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 90/189] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:33 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:34.373932 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-6008a242-7923-41e1-89ea-6fcb7d6d9594 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:34.382435 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-6008a242-7923-41e1-89ea-6fcb7d6d9594 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.260639 Jul 13 21:05:34.391584 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 100/190] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:34 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:34.391739 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-df9379c5-c7e4-489a-b851-21d1a31981c7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:34.391739 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-df9379c5-c7e4-489a-b851-21d1a31981c7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:34.392807 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-df9379c5-c7e4-489a-b851-21d1a31981c7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:34.393415 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-df9379c5-c7e4-489a-b851-21d1a31981c7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:34.394176 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-df9379c5-c7e4-489a-b851-21d1a31981c7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:34.394663 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-df9379c5-c7e4-489a-b851-21d1a31981c7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:34.806271 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-df9379c5-c7e4-489a-b851-21d1a31981c7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:34.813761 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-df9379c5-c7e4-489a-b851-21d1a31981c7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.431243 Jul 13 21:05:34.814319 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 91/191] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:34 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:34.930821 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-74a21417-a7b3-46d1-893b-86550c483808 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:34.931502 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-74a21417-a7b3-46d1-893b-86550c483808 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:34.941512 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-74a21417-a7b3-46d1-893b-86550c483808 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:34.941956 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-74a21417-a7b3-46d1-893b-86550c483808 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:34.942745 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-74a21417-a7b3-46d1-893b-86550c483808 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:34.943180 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-74a21417-a7b3-46d1-893b-86550c483808 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:35.107502 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-74a21417-a7b3-46d1-893b-86550c483808 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:35.115335 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-74a21417-a7b3-46d1-893b-86550c483808 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.188689 Jul 13 21:05:35.115901 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 101/192] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:34 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:35.243276 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-cf963d69-a2ff-4ed3-989b-cf69723a7251 req-b7aa288d-5889-4e90-87f4-d5fee5c12edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52701d54-bab0-4fd7-b5c1-1b0e433d4c9f", "name": "network-vif-plugged", "status": "completed", "tag": "38f6480c-0bdd-4309-9b91-2e38a86a5d27"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:05:35.251622 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-cf963d69-a2ff-4ed3-989b-cf69723a7251 req-b7aa288d-5889-4e90-87f4-d5fee5c12edf service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:35.252054 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-cf963d69-a2ff-4ed3-989b-cf69723a7251 req-b7aa288d-5889-4e90-87f4-d5fee5c12edf service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:35.255966 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ef19f04a-2f16-4c00-a938-cfb1420c8450 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:35.256653 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ef19f04a-2f16-4c00-a938-cfb1420c8450 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:35.262695 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ef19f04a-2f16-4c00-a938-cfb1420c8450 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:35.263137 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ef19f04a-2f16-4c00-a938-cfb1420c8450 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:35.263581 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-cf963d69-a2ff-4ed3-989b-cf69723a7251 req-b7aa288d-5889-4e90-87f4-d5fee5c12edf service nova] Creating event network-vif-plugged:38f6480c-0bdd-4309-9b91-2e38a86a5d27 for instance 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f on hv-cinder-79987 Jul 13 21:05:35.263879 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ef19f04a-2f16-4c00-a938-cfb1420c8450 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:35.264300 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ef19f04a-2f16-4c00-a938-cfb1420c8450 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:35.268589 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-cf963d69-a2ff-4ed3-989b-cf69723a7251 req-b7aa288d-5889-4e90-87f4-d5fee5c12edf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079894 Jul 13 21:05:35.270803 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 92/193] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:05:35.400087 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-3b0adf59-996c-45fb-ba92-94e31883e201 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:35.400867 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-3b0adf59-996c-45fb-ba92-94e31883e201 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:35.401427 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ef19f04a-2f16-4c00-a938-cfb1420c8450 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:35.407241 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3b0adf59-996c-45fb-ba92-94e31883e201 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:35.407793 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3b0adf59-996c-45fb-ba92-94e31883e201 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:35.408631 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3b0adf59-996c-45fb-ba92-94e31883e201 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:35.409142 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3b0adf59-996c-45fb-ba92-94e31883e201 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:35.410249 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ef19f04a-2f16-4c00-a938-cfb1420c8450 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:35.411873 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ef19f04a-2f16-4c00-a938-cfb1420c8450 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:35.413031 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ef19f04a-2f16-4c00-a938-cfb1420c8450 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.161302 Jul 13 21:05:35.413788 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 102/194] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:35 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:05:35.544348 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-3b0adf59-996c-45fb-ba92-94e31883e201 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:35.551670 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-3b0adf59-996c-45fb-ba92-94e31883e201 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.157097 Jul 13 21:05:35.552226 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 93/195] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:35 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:35.830371 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-a0d8b9a9-cbfb-46d2-a7e9-618b4068383d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:35.830999 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-a0d8b9a9-cbfb-46d2-a7e9-618b4068383d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:35.836945 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a0d8b9a9-cbfb-46d2-a7e9-618b4068383d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:35.837388 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a0d8b9a9-cbfb-46d2-a7e9-618b4068383d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:35.838137 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a0d8b9a9-cbfb-46d2-a7e9-618b4068383d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:35.838559 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a0d8b9a9-cbfb-46d2-a7e9-618b4068383d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:35.969274 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-a0d8b9a9-cbfb-46d2-a7e9-618b4068383d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:35.978635 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-a0d8b9a9-cbfb-46d2-a7e9-618b4068383d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.151986 Jul 13 21:05:35.979326 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 103/196] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:35 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:36.131921 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-9341e8eb-84c4-491e-bbd7-8718d4d6b0c9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:36.132599 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-9341e8eb-84c4-491e-bbd7-8718d4d6b0c9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:36.134528 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_api:SELECT=99 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:05:36.140089 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9341e8eb-84c4-491e-bbd7-8718d4d6b0c9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:36.140295 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9341e8eb-84c4-491e-bbd7-8718d4d6b0c9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:36.141510 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9341e8eb-84c4-491e-bbd7-8718d4d6b0c9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:36.141510 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9341e8eb-84c4-491e-bbd7-8718d4d6b0c9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:36.282204 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-9341e8eb-84c4-491e-bbd7-8718d4d6b0c9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:36.290230 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-9341e8eb-84c4-491e-bbd7-8718d4d6b0c9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.162071 Jul 13 21:05:36.290814 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 94/197] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:36 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:36.431126 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ff977794-9a20-43c6-a678-a9e202f564b3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:36.431726 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ff977794-9a20-43c6-a678-a9e202f564b3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:36.437614 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ff977794-9a20-43c6-a678-a9e202f564b3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:36.438060 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ff977794-9a20-43c6-a678-a9e202f564b3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:36.438871 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ff977794-9a20-43c6-a678-a9e202f564b3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:36.439300 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ff977794-9a20-43c6-a678-a9e202f564b3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:36.574573 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-d8a9fd91-661e-4d19-a484-a4a44e4827ab tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:36.574573 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-d8a9fd91-661e-4d19-a484-a4a44e4827ab tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:36.575955 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d8a9fd91-661e-4d19-a484-a4a44e4827ab tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:36.576463 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d8a9fd91-661e-4d19-a484-a4a44e4827ab tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:36.577282 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d8a9fd91-661e-4d19-a484-a4a44e4827ab tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:36.577777 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d8a9fd91-661e-4d19-a484-a4a44e4827ab tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:36.610562 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ff977794-9a20-43c6-a678-a9e202f564b3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:36.618526 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ff977794-9a20-43c6-a678-a9e202f564b3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:36.620167 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ff977794-9a20-43c6-a678-a9e202f564b3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:36.621338 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ff977794-9a20-43c6-a678-a9e202f564b3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.194036 Jul 13 21:05:36.621967 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 104/198] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:36 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:36.714121 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-d8a9fd91-661e-4d19-a484-a4a44e4827ab tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:36.721701 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-d8a9fd91-661e-4d19-a484-a4a44e4827ab tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.157011 Jul 13 21:05:36.729149 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 95/199] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:36 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:36.995964 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-97ff1ff2-a3ca-4692-85b2-0524973a89c0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:36.996568 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-97ff1ff2-a3ca-4692-85b2-0524973a89c0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:37.002454 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-97ff1ff2-a3ca-4692-85b2-0524973a89c0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:37.002928 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-97ff1ff2-a3ca-4692-85b2-0524973a89c0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:37.006473 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-97ff1ff2-a3ca-4692-85b2-0524973a89c0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:37.006473 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-97ff1ff2-a3ca-4692-85b2-0524973a89c0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:37.146094 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-97ff1ff2-a3ca-4692-85b2-0524973a89c0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:37.153981 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-97ff1ff2-a3ca-4692-85b2-0524973a89c0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.161568 Jul 13 21:05:37.154690 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 105/200] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:36 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:37.306423 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-6f5c7dcd-0b5b-4df6-988f-751df393a07d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:37.307054 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-6f5c7dcd-0b5b-4df6-988f-751df393a07d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:37.312874 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6f5c7dcd-0b5b-4df6-988f-751df393a07d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:37.313317 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6f5c7dcd-0b5b-4df6-988f-751df393a07d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:37.314067 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6f5c7dcd-0b5b-4df6-988f-751df393a07d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:37.314497 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6f5c7dcd-0b5b-4df6-988f-751df393a07d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:37.442471 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-6f5c7dcd-0b5b-4df6-988f-751df393a07d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:37.449989 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-6f5c7dcd-0b5b-4df6-988f-751df393a07d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.147392 Jul 13 21:05:37.450553 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 96/201] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:37 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:37.639303 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-5e27bf2d-5444-480f-ac5e-3134a1a79aec tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:37.639912 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-5e27bf2d-5444-480f-ac5e-3134a1a79aec tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:37.645900 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5e27bf2d-5444-480f-ac5e-3134a1a79aec tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:37.646343 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5e27bf2d-5444-480f-ac5e-3134a1a79aec tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:37.647153 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5e27bf2d-5444-480f-ac5e-3134a1a79aec tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:37.647577 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5e27bf2d-5444-480f-ac5e-3134a1a79aec tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:37.740706 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-226c9e7d-a5a5-40b3-bcff-dd7431913174 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:37.741727 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-226c9e7d-a5a5-40b3-bcff-dd7431913174 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:37.748325 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-226c9e7d-a5a5-40b3-bcff-dd7431913174 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:37.748954 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-226c9e7d-a5a5-40b3-bcff-dd7431913174 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:37.749865 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-226c9e7d-a5a5-40b3-bcff-dd7431913174 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:37.750498 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-226c9e7d-a5a5-40b3-bcff-dd7431913174 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:37.782174 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5e27bf2d-5444-480f-ac5e-3134a1a79aec tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:37.792932 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5e27bf2d-5444-480f-ac5e-3134a1a79aec tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:37.794721 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5e27bf2d-5444-480f-ac5e-3134a1a79aec tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:37.795903 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-5e27bf2d-5444-480f-ac5e-3134a1a79aec tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.160715 Jul 13 21:05:37.803145 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 106/202] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:37 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:37.885569 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-226c9e7d-a5a5-40b3-bcff-dd7431913174 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:37.893875 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-226c9e7d-a5a5-40b3-bcff-dd7431913174 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.157513 Jul 13 21:05:37.894930 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 97/203] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:37 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:38.170806 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-f1db3d93-89a3-46b6-9359-aee030b81767 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:38.171496 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-f1db3d93-89a3-46b6-9359-aee030b81767 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:38.177415 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f1db3d93-89a3-46b6-9359-aee030b81767 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:38.177922 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f1db3d93-89a3-46b6-9359-aee030b81767 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:38.178768 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f1db3d93-89a3-46b6-9359-aee030b81767 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:38.179258 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f1db3d93-89a3-46b6-9359-aee030b81767 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:38.306962 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-f1db3d93-89a3-46b6-9359-aee030b81767 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:38.314158 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-f1db3d93-89a3-46b6-9359-aee030b81767 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.147141 Jul 13 21:05:38.314731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 107/204] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:38 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:38.466706 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-3b0f3a50-84c2-4ab6-a2d9-63015c1f63cc tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:38.467493 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-3b0f3a50-84c2-4ab6-a2d9-63015c1f63cc tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:38.473487 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3b0f3a50-84c2-4ab6-a2d9-63015c1f63cc tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:38.473936 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3b0f3a50-84c2-4ab6-a2d9-63015c1f63cc tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:38.474718 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3b0f3a50-84c2-4ab6-a2d9-63015c1f63cc tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:38.475149 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3b0f3a50-84c2-4ab6-a2d9-63015c1f63cc tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:38.603901 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-3b0f3a50-84c2-4ab6-a2d9-63015c1f63cc tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:38.611206 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-3b0f3a50-84c2-4ab6-a2d9-63015c1f63cc tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.148501 Jul 13 21:05:38.611773 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 98/205] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:38 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:38.815454 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-bb6b8a21-a9a1-41b4-b770-926cd9001396 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:38.816567 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-bb6b8a21-a9a1-41b4-b770-926cd9001396 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:38.822464 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bb6b8a21-a9a1-41b4-b770-926cd9001396 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:38.822936 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bb6b8a21-a9a1-41b4-b770-926cd9001396 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:38.823682 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bb6b8a21-a9a1-41b4-b770-926cd9001396 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:38.824131 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bb6b8a21-a9a1-41b4-b770-926cd9001396 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:38.911680 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-92fac40c-a552-404d-b576-dba8fe8fa3a5 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:38.912282 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-92fac40c-a552-404d-b576-dba8fe8fa3a5 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:38.918219 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-92fac40c-a552-404d-b576-dba8fe8fa3a5 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:38.918697 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-92fac40c-a552-404d-b576-dba8fe8fa3a5 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:38.919450 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-92fac40c-a552-404d-b576-dba8fe8fa3a5 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:38.919879 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-92fac40c-a552-404d-b576-dba8fe8fa3a5 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:38.950846 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-bb6b8a21-a9a1-41b4-b770-926cd9001396 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:38.959011 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-bb6b8a21-a9a1-41b4-b770-926cd9001396 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:38.960320 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-bb6b8a21-a9a1-41b4-b770-926cd9001396 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:38.961694 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-bb6b8a21-a9a1-41b4-b770-926cd9001396 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.150085 Jul 13 21:05:38.962545 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 108/206] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:38 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:39.045744 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-92fac40c-a552-404d-b576-dba8fe8fa3a5 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:39.053638 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-92fac40c-a552-404d-b576-dba8fe8fa3a5 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.145697 Jul 13 21:05:39.054197 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 99/207] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:38 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:39.331691 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-67d82cdc-f6f1-4086-8e83-302074469fed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:39.332301 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-67d82cdc-f6f1-4086-8e83-302074469fed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:39.338320 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-67d82cdc-f6f1-4086-8e83-302074469fed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:39.338811 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-67d82cdc-f6f1-4086-8e83-302074469fed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:39.339564 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-67d82cdc-f6f1-4086-8e83-302074469fed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:39.339998 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-67d82cdc-f6f1-4086-8e83-302074469fed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:39.462486 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-67d82cdc-f6f1-4086-8e83-302074469fed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:39.469853 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-67d82cdc-f6f1-4086-8e83-302074469fed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.142100 Jul 13 21:05:39.470421 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 109/208] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:39 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:39.628376 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-182aa025-1176-4198-970d-e02cefaddcb2 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:39.628985 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-182aa025-1176-4198-970d-e02cefaddcb2 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:39.634923 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-182aa025-1176-4198-970d-e02cefaddcb2 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:39.635369 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-182aa025-1176-4198-970d-e02cefaddcb2 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:39.636113 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-182aa025-1176-4198-970d-e02cefaddcb2 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:39.636544 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-182aa025-1176-4198-970d-e02cefaddcb2 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:39.768177 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-182aa025-1176-4198-970d-e02cefaddcb2 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:39.776372 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-182aa025-1176-4198-970d-e02cefaddcb2 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.151771 Jul 13 21:05:39.776920 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 100/209] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:39 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:39.980662 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-396aee89-aaa9-46a9-85da-b14a1fbd680b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:39.981210 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-396aee89-aaa9-46a9-85da-b14a1fbd680b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:39.987137 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-396aee89-aaa9-46a9-85da-b14a1fbd680b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:39.987574 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-396aee89-aaa9-46a9-85da-b14a1fbd680b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:39.988315 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-396aee89-aaa9-46a9-85da-b14a1fbd680b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:39.988737 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-396aee89-aaa9-46a9-85da-b14a1fbd680b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:40.071510 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-199781e0-5b44-47a4-a6e9-813dbdd82562 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:40.072160 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-199781e0-5b44-47a4-a6e9-813dbdd82562 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:40.078594 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-199781e0-5b44-47a4-a6e9-813dbdd82562 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:40.079070 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-199781e0-5b44-47a4-a6e9-813dbdd82562 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:40.079873 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-199781e0-5b44-47a4-a6e9-813dbdd82562 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:40.080312 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-199781e0-5b44-47a4-a6e9-813dbdd82562 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:40.126766 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-396aee89-aaa9-46a9-85da-b14a1fbd680b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:40.135296 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-396aee89-aaa9-46a9-85da-b14a1fbd680b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:40.136793 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-396aee89-aaa9-46a9-85da-b14a1fbd680b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:40.137877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-396aee89-aaa9-46a9-85da-b14a1fbd680b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.161356 Jul 13 21:05:40.138438 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 110/210] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:39 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:40.207985 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-199781e0-5b44-47a4-a6e9-813dbdd82562 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:40.215335 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-199781e0-5b44-47a4-a6e9-813dbdd82562 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.149128 Jul 13 21:05:40.215915 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 101/211] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:40 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:40.487311 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-3de6c7ed-d096-4343-8e03-b6b84487232e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:40.488509 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-3de6c7ed-d096-4343-8e03-b6b84487232e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:40.494458 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3de6c7ed-d096-4343-8e03-b6b84487232e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:40.494944 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3de6c7ed-d096-4343-8e03-b6b84487232e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:40.495701 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3de6c7ed-d096-4343-8e03-b6b84487232e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:40.496127 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3de6c7ed-d096-4343-8e03-b6b84487232e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:40.634327 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3de6c7ed-d096-4343-8e03-b6b84487232e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:40.637942 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=100 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:05:40.642901 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-3de6c7ed-d096-4343-8e03-b6b84487232e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.159562 Jul 13 21:05:40.643454 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 111/212] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:40 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:40.793131 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-4e77a6ce-0825-4633-8542-ae45d3d86ee7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:40.793825 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-4e77a6ce-0825-4633-8542-ae45d3d86ee7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:40.799841 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4e77a6ce-0825-4633-8542-ae45d3d86ee7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:40.800926 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4e77a6ce-0825-4633-8542-ae45d3d86ee7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:40.801683 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4e77a6ce-0825-4633-8542-ae45d3d86ee7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:40.802106 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4e77a6ce-0825-4633-8542-ae45d3d86ee7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:40.929710 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-4e77a6ce-0825-4633-8542-ae45d3d86ee7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:40.936941 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-4e77a6ce-0825-4633-8542-ae45d3d86ee7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.147756 Jul 13 21:05:40.937498 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 102/213] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:40 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:41.154960 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-39e2bef5-21d9-4d81-9150-0709ef79033e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:41.155558 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-39e2bef5-21d9-4d81-9150-0709ef79033e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:41.162278 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-39e2bef5-21d9-4d81-9150-0709ef79033e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:41.162748 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-39e2bef5-21d9-4d81-9150-0709ef79033e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:41.163513 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-39e2bef5-21d9-4d81-9150-0709ef79033e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:41.163934 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-39e2bef5-21d9-4d81-9150-0709ef79033e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:41.236802 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-d6a285ea-dfea-4804-b50d-d50bef0f1a94 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:41.237411 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-d6a285ea-dfea-4804-b50d-d50bef0f1a94 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:41.243343 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d6a285ea-dfea-4804-b50d-d50bef0f1a94 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:41.243790 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d6a285ea-dfea-4804-b50d-d50bef0f1a94 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:41.244551 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d6a285ea-dfea-4804-b50d-d50bef0f1a94 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:41.244983 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d6a285ea-dfea-4804-b50d-d50bef0f1a94 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:41.295222 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-39e2bef5-21d9-4d81-9150-0709ef79033e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:41.303038 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-39e2bef5-21d9-4d81-9150-0709ef79033e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:41.304528 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-39e2bef5-21d9-4d81-9150-0709ef79033e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:41.305614 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-39e2bef5-21d9-4d81-9150-0709ef79033e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.154510 Jul 13 21:05:41.306160 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 112/214] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:41 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:41.372230 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-d6a285ea-dfea-4804-b50d-d50bef0f1a94 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:41.380308 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-d6a285ea-dfea-4804-b50d-d50bef0f1a94 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.151954 Jul 13 21:05:41.380884 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 103/215] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:41 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:41.659908 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-b75c8159-bf74-4163-86db-99c74d88ca6a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:41.660509 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-b75c8159-bf74-4163-86db-99c74d88ca6a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:41.666462 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b75c8159-bf74-4163-86db-99c74d88ca6a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:41.666944 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b75c8159-bf74-4163-86db-99c74d88ca6a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:41.667700 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b75c8159-bf74-4163-86db-99c74d88ca6a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:41.668130 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b75c8159-bf74-4163-86db-99c74d88ca6a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:41.940203 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b75c8159-bf74-4163-86db-99c74d88ca6a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:41.949135 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-b75c8159-bf74-4163-86db-99c74d88ca6a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.292893 Jul 13 21:05:41.949700 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 113/216] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:41 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:41.953018 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-f5746ec5-567f-4aa0-92d4-929c5bf66e04 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:41.953616 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-f5746ec5-567f-4aa0-92d4-929c5bf66e04 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:41.959512 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f5746ec5-567f-4aa0-92d4-929c5bf66e04 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:41.959949 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f5746ec5-567f-4aa0-92d4-929c5bf66e04 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:41.960684 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f5746ec5-567f-4aa0-92d4-929c5bf66e04 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:41.961107 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f5746ec5-567f-4aa0-92d4-929c5bf66e04 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:42.089431 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f5746ec5-567f-4aa0-92d4-929c5bf66e04 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:42.096784 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-f5746ec5-567f-4aa0-92d4-929c5bf66e04 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.147431 Jul 13 21:05:42.097777 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 104/217] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:41 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:42.323360 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-f57c6a68-098c-4d05-bf4a-c51fc4a45db5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:42.323956 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-f57c6a68-098c-4d05-bf4a-c51fc4a45db5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:42.329902 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f57c6a68-098c-4d05-bf4a-c51fc4a45db5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:42.330338 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f57c6a68-098c-4d05-bf4a-c51fc4a45db5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:42.331103 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f57c6a68-098c-4d05-bf4a-c51fc4a45db5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:42.331529 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f57c6a68-098c-4d05-bf4a-c51fc4a45db5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:42.396851 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-8dd8587f-7f0c-4745-b823-aa6ab83918da tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:42.397568 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-8dd8587f-7f0c-4745-b823-aa6ab83918da tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:42.403855 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8dd8587f-7f0c-4745-b823-aa6ab83918da tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:42.404305 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8dd8587f-7f0c-4745-b823-aa6ab83918da tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:42.405066 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8dd8587f-7f0c-4745-b823-aa6ab83918da tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:42.405671 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8dd8587f-7f0c-4745-b823-aa6ab83918da tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:42.455442 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-f57c6a68-098c-4d05-bf4a-c51fc4a45db5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:42.463731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-f57c6a68-098c-4d05-bf4a-c51fc4a45db5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:42.465208 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-f57c6a68-098c-4d05-bf4a-c51fc4a45db5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:42.466296 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-f57c6a68-098c-4d05-bf4a-c51fc4a45db5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.146744 Jul 13 21:05:42.466892 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 114/218] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:42 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:42.533472 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-8dd8587f-7f0c-4745-b823-aa6ab83918da tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:42.541427 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-8dd8587f-7f0c-4745-b823-aa6ab83918da tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.148937 Jul 13 21:05:42.541987 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 105/219] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:42 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:42.966071 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-d8cc47e9-9c21-459b-a875-14937a6e5a9d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:42.966598 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-d8cc47e9-9c21-459b-a875-14937a6e5a9d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:42.972750 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d8cc47e9-9c21-459b-a875-14937a6e5a9d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:42.973190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d8cc47e9-9c21-459b-a875-14937a6e5a9d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:42.973942 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d8cc47e9-9c21-459b-a875-14937a6e5a9d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:42.974366 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d8cc47e9-9c21-459b-a875-14937a6e5a9d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:43.101912 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-d8cc47e9-9c21-459b-a875-14937a6e5a9d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:43.109347 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-d8cc47e9-9c21-459b-a875-14937a6e5a9d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.147006 Jul 13 21:05:43.109915 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 115/220] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:42 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:43.113556 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-93281502-5ff4-4ade-9486-8578a1131c70 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:43.114147 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-93281502-5ff4-4ade-9486-8578a1131c70 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:43.120069 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-93281502-5ff4-4ade-9486-8578a1131c70 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:43.120505 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-93281502-5ff4-4ade-9486-8578a1131c70 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:43.121241 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-93281502-5ff4-4ade-9486-8578a1131c70 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:43.121664 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-93281502-5ff4-4ade-9486-8578a1131c70 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:43.245771 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-93281502-5ff4-4ade-9486-8578a1131c70 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:43.253192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-93281502-5ff4-4ade-9486-8578a1131c70 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.143915 Jul 13 21:05:43.254391 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 106/221] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:43 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:43.485565 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-76f3331e-aefd-40ae-b646-a045457a9b58 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:43.486165 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-76f3331e-aefd-40ae-b646-a045457a9b58 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:43.493524 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-76f3331e-aefd-40ae-b646-a045457a9b58 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:43.494252 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-76f3331e-aefd-40ae-b646-a045457a9b58 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:43.496124 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-76f3331e-aefd-40ae-b646-a045457a9b58 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:43.496225 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-76f3331e-aefd-40ae-b646-a045457a9b58 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:43.557479 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-a9d75d9b-0314-4b4f-ab44-0ccf0d3e0719 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:43.558170 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-a9d75d9b-0314-4b4f-ab44-0ccf0d3e0719 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:43.564294 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a9d75d9b-0314-4b4f-ab44-0ccf0d3e0719 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:43.564736 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a9d75d9b-0314-4b4f-ab44-0ccf0d3e0719 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:43.565491 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a9d75d9b-0314-4b4f-ab44-0ccf0d3e0719 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:43.565918 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a9d75d9b-0314-4b4f-ab44-0ccf0d3e0719 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:43.570644 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=100 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:05:43.626240 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-76f3331e-aefd-40ae-b646-a045457a9b58 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:43.635196 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-76f3331e-aefd-40ae-b646-a045457a9b58 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:43.637034 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-76f3331e-aefd-40ae-b646-a045457a9b58 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:43.638136 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-76f3331e-aefd-40ae-b646-a045457a9b58 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.157079 Jul 13 21:05:43.638815 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 116/222] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:43 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:43.711547 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-a9d75d9b-0314-4b4f-ab44-0ccf0d3e0719 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:43.718877 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-a9d75d9b-0314-4b4f-ab44-0ccf0d3e0719 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.165252 Jul 13 21:05:43.719443 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 107/223] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:43 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:44.126754 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-6e541a57-9358-4d02-88f5-2ec56bc2400d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:44.127306 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-6e541a57-9358-4d02-88f5-2ec56bc2400d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:44.133323 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6e541a57-9358-4d02-88f5-2ec56bc2400d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:44.133762 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6e541a57-9358-4d02-88f5-2ec56bc2400d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:44.134504 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6e541a57-9358-4d02-88f5-2ec56bc2400d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:44.134956 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6e541a57-9358-4d02-88f5-2ec56bc2400d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:44.262090 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-6e541a57-9358-4d02-88f5-2ec56bc2400d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:44.270104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-6e541a57-9358-4d02-88f5-2ec56bc2400d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.147223 Jul 13 21:05:44.271019 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 117/224] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:44 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:44.272261 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-cb44ac9d-87e6-47ce-8384-f5a568d9b8d4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:44.272871 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-cb44ac9d-87e6-47ce-8384-f5a568d9b8d4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:44.279930 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-cb44ac9d-87e6-47ce-8384-f5a568d9b8d4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:44.280739 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-cb44ac9d-87e6-47ce-8384-f5a568d9b8d4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:44.281147 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-cb44ac9d-87e6-47ce-8384-f5a568d9b8d4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:44.281580 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-cb44ac9d-87e6-47ce-8384-f5a568d9b8d4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:44.408813 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-cb44ac9d-87e6-47ce-8384-f5a568d9b8d4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:44.416037 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-cb44ac9d-87e6-47ce-8384-f5a568d9b8d4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.148607 Jul 13 21:05:44.416596 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 108/225] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:44 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:44.655904 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-04a0ec39-ec88-41c1-9b4f-0b2498e6e553 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:44.656546 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-04a0ec39-ec88-41c1-9b4f-0b2498e6e553 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:44.662392 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-04a0ec39-ec88-41c1-9b4f-0b2498e6e553 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:44.662858 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-04a0ec39-ec88-41c1-9b4f-0b2498e6e553 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:44.663598 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-04a0ec39-ec88-41c1-9b4f-0b2498e6e553 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:44.664047 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-04a0ec39-ec88-41c1-9b4f-0b2498e6e553 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:44.736338 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-9b9adeb3-9ff3-420f-9cf4-539ed0c40dac tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:44.736972 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-9b9adeb3-9ff3-420f-9cf4-539ed0c40dac tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:44.750677 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9b9adeb3-9ff3-420f-9cf4-539ed0c40dac tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:44.751125 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9b9adeb3-9ff3-420f-9cf4-539ed0c40dac tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:44.751897 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9b9adeb3-9ff3-420f-9cf4-539ed0c40dac tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:44.752333 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9b9adeb3-9ff3-420f-9cf4-539ed0c40dac tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:44.824204 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-04a0ec39-ec88-41c1-9b4f-0b2498e6e553 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:44.832895 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-04a0ec39-ec88-41c1-9b4f-0b2498e6e553 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:44.834552 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-04a0ec39-ec88-41c1-9b4f-0b2498e6e553 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:44.835671 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-04a0ec39-ec88-41c1-9b4f-0b2498e6e553 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.183647 Jul 13 21:05:44.836261 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 118/226] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:44 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:05:45.120367 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-9b9adeb3-9ff3-420f-9cf4-539ed0c40dac tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:45.128069 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-9b9adeb3-9ff3-420f-9cf4-539ed0c40dac tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.395511 Jul 13 21:05:45.128682 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 109/227] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:44 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:45.287694 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-cb333218-2afe-4582-937d-068db45928c0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:45.288294 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-cb333218-2afe-4582-937d-068db45928c0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:45.294175 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-cb333218-2afe-4582-937d-068db45928c0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:45.294637 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-cb333218-2afe-4582-937d-068db45928c0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:45.295404 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-cb333218-2afe-4582-937d-068db45928c0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:45.295829 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-cb333218-2afe-4582-937d-068db45928c0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:45.433055 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-77207fea-3a48-4b8d-acc1-f4c19d2f8cb4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:45.433870 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-77207fea-3a48-4b8d-acc1-f4c19d2f8cb4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:45.448373 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-77207fea-3a48-4b8d-acc1-f4c19d2f8cb4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:45.448874 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-77207fea-3a48-4b8d-acc1-f4c19d2f8cb4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:45.449738 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-77207fea-3a48-4b8d-acc1-f4c19d2f8cb4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:45.450212 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-77207fea-3a48-4b8d-acc1-f4c19d2f8cb4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:45.472967 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-cb333218-2afe-4582-937d-068db45928c0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:45.485470 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-cb333218-2afe-4582-937d-068db45928c0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.200271 Jul 13 21:05:45.486771 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 119/228] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:45 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:45.751539 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-77207fea-3a48-4b8d-acc1-f4c19d2f8cb4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:45.759571 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-77207fea-3a48-4b8d-acc1-f4c19d2f8cb4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.330393 Jul 13 21:05:45.760177 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 110/229] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:45 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:45.853139 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-5e8cc7a8-7b76-483d-ac47-a8ede79f54cd tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:45.853757 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-5e8cc7a8-7b76-483d-ac47-a8ede79f54cd tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:45.860404 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5e8cc7a8-7b76-483d-ac47-a8ede79f54cd tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:45.860863 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5e8cc7a8-7b76-483d-ac47-a8ede79f54cd tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:45.862277 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5e8cc7a8-7b76-483d-ac47-a8ede79f54cd tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:45.862797 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5e8cc7a8-7b76-483d-ac47-a8ede79f54cd tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:46.015834 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5e8cc7a8-7b76-483d-ac47-a8ede79f54cd tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:46.026214 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5e8cc7a8-7b76-483d-ac47-a8ede79f54cd tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:46.027756 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5e8cc7a8-7b76-483d-ac47-a8ede79f54cd tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:46.029343 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-5e8cc7a8-7b76-483d-ac47-a8ede79f54cd tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.179726 Jul 13 21:05:46.030170 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 120/230] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:45 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:46.144224 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-1509d560-08ff-4486-8e01-90857732c13e tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:46.145042 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-1509d560-08ff-4486-8e01-90857732c13e tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:46.152233 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1509d560-08ff-4486-8e01-90857732c13e tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:46.152683 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1509d560-08ff-4486-8e01-90857732c13e tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:46.153448 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1509d560-08ff-4486-8e01-90857732c13e tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:46.153883 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1509d560-08ff-4486-8e01-90857732c13e tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:46.316387 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-1509d560-08ff-4486-8e01-90857732c13e tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:46.324784 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-1509d560-08ff-4486-8e01-90857732c13e tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.184281 Jul 13 21:05:46.326812 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 111/231] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:46 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:46.502847 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-d0353796-28fb-4326-b34b-a67135a59920 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:46.509868 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-2baee301-3877-48de-904e-7ff0579bccf6 req-b4f14484-ca3b-45a7-9695-60c568ba44f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ed35cd9-7632-4570-b17d-c08b19ed09d8", "name": "network-vif-plugged", "status": "completed", "tag": "2fcd8530-2884-4c9c-a739-6fbe50c8a3ff"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:05:46.513104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-d0353796-28fb-4326-b34b-a67135a59920 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:46.525908 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d0353796-28fb-4326-b34b-a67135a59920 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:46.526360 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d0353796-28fb-4326-b34b-a67135a59920 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:46.528365 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-2baee301-3877-48de-904e-7ff0579bccf6 req-b4f14484-ca3b-45a7-9695-60c568ba44f3 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:46.528717 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-2baee301-3877-48de-904e-7ff0579bccf6 req-b4f14484-ca3b-45a7-9695-60c568ba44f3 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:46.533144 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d0353796-28fb-4326-b34b-a67135a59920 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:46.533584 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d0353796-28fb-4326-b34b-a67135a59920 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:46.546920 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-2baee301-3877-48de-904e-7ff0579bccf6 req-b4f14484-ca3b-45a7-9695-60c568ba44f3 service nova] Creating event network-vif-plugged:2fcd8530-2884-4c9c-a739-6fbe50c8a3ff for instance 8ed35cd9-7632-4570-b17d-c08b19ed09d8 on hv-cinder-79987 Jul 13 21:05:46.552909 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-2baee301-3877-48de-904e-7ff0579bccf6 req-b4f14484-ca3b-45a7-9695-60c568ba44f3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047245 Jul 13 21:05:46.553774 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 112/232] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:05:46.692095 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-d0353796-28fb-4326-b34b-a67135a59920 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:46.701950 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-d0353796-28fb-4326-b34b-a67135a59920 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.203238 Jul 13 21:05:46.702831 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 121/233] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:46 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:46.782949 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-94ddbcfc-d0c6-435d-a8ef-58becea5d27b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:46.783860 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-94ddbcfc-d0c6-435d-a8ef-58becea5d27b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:46.790915 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-94ddbcfc-d0c6-435d-a8ef-58becea5d27b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:46.791437 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-94ddbcfc-d0c6-435d-a8ef-58becea5d27b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:46.792325 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-94ddbcfc-d0c6-435d-a8ef-58becea5d27b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:46.792856 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-94ddbcfc-d0c6-435d-a8ef-58becea5d27b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:46.951891 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-94ddbcfc-d0c6-435d-a8ef-58becea5d27b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:46.961217 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-94ddbcfc-d0c6-435d-a8ef-58becea5d27b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.186248 Jul 13 21:05:46.961811 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 113/234] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:46 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:47.049037 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ff8f2dd3-8192-4553-b7d6-f4b63e66ed7c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:47.050306 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ff8f2dd3-8192-4553-b7d6-f4b63e66ed7c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:47.058414 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ff8f2dd3-8192-4553-b7d6-f4b63e66ed7c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:47.058592 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ff8f2dd3-8192-4553-b7d6-f4b63e66ed7c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:47.059606 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ff8f2dd3-8192-4553-b7d6-f4b63e66ed7c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:47.060117 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ff8f2dd3-8192-4553-b7d6-f4b63e66ed7c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:47.213477 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ff8f2dd3-8192-4553-b7d6-f4b63e66ed7c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:47.222931 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ff8f2dd3-8192-4553-b7d6-f4b63e66ed7c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:47.224432 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ff8f2dd3-8192-4553-b7d6-f4b63e66ed7c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:47.225601 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ff8f2dd3-8192-4553-b7d6-f4b63e66ed7c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.181052 Jul 13 21:05:47.226195 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 122/235] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:47 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:47.344540 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-d3b6b64b-4d08-4f2e-b9e0-3d7b5a9ebad8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:47.345291 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-d3b6b64b-4d08-4f2e-b9e0-3d7b5a9ebad8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:47.351450 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d3b6b64b-4d08-4f2e-b9e0-3d7b5a9ebad8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:47.351996 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d3b6b64b-4d08-4f2e-b9e0-3d7b5a9ebad8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:47.352846 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d3b6b64b-4d08-4f2e-b9e0-3d7b5a9ebad8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:47.353372 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d3b6b64b-4d08-4f2e-b9e0-3d7b5a9ebad8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:47.532923 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-d3b6b64b-4d08-4f2e-b9e0-3d7b5a9ebad8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:47.548036 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-d3b6b64b-4d08-4f2e-b9e0-3d7b5a9ebad8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.207952 Jul 13 21:05:47.548613 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 114/236] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:47 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:47.720182 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-89cc713d-cdd1-4e9d-9e14-62e29f911bed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:47.720984 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-89cc713d-cdd1-4e9d-9e14-62e29f911bed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:47.727163 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-89cc713d-cdd1-4e9d-9e14-62e29f911bed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:47.727735 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-89cc713d-cdd1-4e9d-9e14-62e29f911bed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:47.728603 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-89cc713d-cdd1-4e9d-9e14-62e29f911bed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:47.729222 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-89cc713d-cdd1-4e9d-9e14-62e29f911bed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:47.876550 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-89cc713d-cdd1-4e9d-9e14-62e29f911bed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:47.885765 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-89cc713d-cdd1-4e9d-9e14-62e29f911bed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.169649 Jul 13 21:05:47.887041 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 123/237] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:47 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:47.978426 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-97bbcef4-1396-4d4e-834b-6e5cec70a9c4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:47.979056 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-97bbcef4-1396-4d4e-834b-6e5cec70a9c4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:47.985191 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-97bbcef4-1396-4d4e-834b-6e5cec70a9c4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:47.985697 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-97bbcef4-1396-4d4e-834b-6e5cec70a9c4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:47.986572 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-97bbcef4-1396-4d4e-834b-6e5cec70a9c4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:47.987099 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-97bbcef4-1396-4d4e-834b-6e5cec70a9c4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:48.124197 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-97bbcef4-1396-4d4e-834b-6e5cec70a9c4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:48.132852 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-97bbcef4-1396-4d4e-834b-6e5cec70a9c4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.158556 Jul 13 21:05:48.133416 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 115/238] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:47 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:48.244279 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-e4fa5be1-989e-4e3e-8393-9e34f524d9a4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:48.244962 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-e4fa5be1-989e-4e3e-8393-9e34f524d9a4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:48.251134 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e4fa5be1-989e-4e3e-8393-9e34f524d9a4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:48.251635 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e4fa5be1-989e-4e3e-8393-9e34f524d9a4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:48.252448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e4fa5be1-989e-4e3e-8393-9e34f524d9a4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:48.252943 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e4fa5be1-989e-4e3e-8393-9e34f524d9a4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:48.455050 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-e4fa5be1-989e-4e3e-8393-9e34f524d9a4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:48.464264 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-e4fa5be1-989e-4e3e-8393-9e34f524d9a4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:48.466078 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-e4fa5be1-989e-4e3e-8393-9e34f524d9a4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:48.467322 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-e4fa5be1-989e-4e3e-8393-9e34f524d9a4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.227353 Jul 13 21:05:48.467977 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 124/239] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:48 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:48.564961 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ad7e8798-4dd0-4bdb-8308-ee1561747b31 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:48.566222 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-ad7e8798-4dd0-4bdb-8308-ee1561747b31 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:48.572227 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ad7e8798-4dd0-4bdb-8308-ee1561747b31 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:48.572860 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ad7e8798-4dd0-4bdb-8308-ee1561747b31 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:48.573928 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ad7e8798-4dd0-4bdb-8308-ee1561747b31 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:48.574366 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ad7e8798-4dd0-4bdb-8308-ee1561747b31 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:48.718339 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ad7e8798-4dd0-4bdb-8308-ee1561747b31 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:48.729832 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ad7e8798-4dd0-4bdb-8308-ee1561747b31 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.168463 Jul 13 21:05:48.730641 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 116/240] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:48 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:48.904543 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-301ebe16-34d2-4ba1-9f85-4d8304d72bf4 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:48.913220 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-301ebe16-34d2-4ba1-9f85-4d8304d72bf4 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:48.937713 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-301ebe16-34d2-4ba1-9f85-4d8304d72bf4 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:48.939093 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-301ebe16-34d2-4ba1-9f85-4d8304d72bf4 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:48.944473 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-301ebe16-34d2-4ba1-9f85-4d8304d72bf4 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:48.945431 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-301ebe16-34d2-4ba1-9f85-4d8304d72bf4 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:49.150655 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-bae8a441-e06a-45d0-9136-19dd056cd75b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:49.151733 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-bae8a441-e06a-45d0-9136-19dd056cd75b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:49.159899 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-301ebe16-34d2-4ba1-9f85-4d8304d72bf4 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:49.161590 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bae8a441-e06a-45d0-9136-19dd056cd75b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:49.163005 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bae8a441-e06a-45d0-9136-19dd056cd75b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:49.164821 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bae8a441-e06a-45d0-9136-19dd056cd75b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:49.166053 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bae8a441-e06a-45d0-9136-19dd056cd75b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:49.171694 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-301ebe16-34d2-4ba1-9f85-4d8304d72bf4 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.272784 Jul 13 21:05:49.173046 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 125/241] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:48 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:49.486324 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-2cac43da-c0a5-425a-a259-aa4a8e32bbba tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:49.487021 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-2cac43da-c0a5-425a-a259-aa4a8e32bbba tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:49.510893 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2cac43da-c0a5-425a-a259-aa4a8e32bbba tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:49.511359 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2cac43da-c0a5-425a-a259-aa4a8e32bbba tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:49.512149 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2cac43da-c0a5-425a-a259-aa4a8e32bbba tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:49.512582 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2cac43da-c0a5-425a-a259-aa4a8e32bbba tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:49.581897 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-bae8a441-e06a-45d0-9136-19dd056cd75b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:49.592761 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-bae8a441-e06a-45d0-9136-19dd056cd75b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1366 microversion: 2.1 time: 0.447316 Jul 13 21:05:49.593646 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 117/242] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:49 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1366 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:49.690560 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-2cac43da-c0a5-425a-a259-aa4a8e32bbba tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:49.698885 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-2cac43da-c0a5-425a-a259-aa4a8e32bbba tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:49.700737 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-2cac43da-c0a5-425a-a259-aa4a8e32bbba tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:49.701847 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-2cac43da-c0a5-425a-a259-aa4a8e32bbba tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.220379 Jul 13 21:05:49.702393 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 126/243] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:49 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:49.747457 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b191d5c1-bfc8-4b66-8046-3d2d99b37419 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:49.748313 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b191d5c1-bfc8-4b66-8046-3d2d99b37419 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:49.757122 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b191d5c1-bfc8-4b66-8046-3d2d99b37419 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:49.757571 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b191d5c1-bfc8-4b66-8046-3d2d99b37419 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:49.758360 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b191d5c1-bfc8-4b66-8046-3d2d99b37419 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:49.758824 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b191d5c1-bfc8-4b66-8046-3d2d99b37419 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:49.932853 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b191d5c1-bfc8-4b66-8046-3d2d99b37419 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:49.940839 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b191d5c1-bfc8-4b66-8046-3d2d99b37419 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.197513 Jul 13 21:05:49.941390 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 118/244] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:49 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:50.192091 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-3d419769-3185-4d3a-9c1f-8bed0f3e5f74 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:50.192900 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-3d419769-3185-4d3a-9c1f-8bed0f3e5f74 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:50.202230 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3d419769-3185-4d3a-9c1f-8bed0f3e5f74 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:50.203049 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3d419769-3185-4d3a-9c1f-8bed0f3e5f74 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:50.203918 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3d419769-3185-4d3a-9c1f-8bed0f3e5f74 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:50.204413 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3d419769-3185-4d3a-9c1f-8bed0f3e5f74 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:50.359408 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3d419769-3185-4d3a-9c1f-8bed0f3e5f74 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:50.367052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-3d419769-3185-4d3a-9c1f-8bed0f3e5f74 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.179412 Jul 13 21:05:50.367611 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 127/245] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:50 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:50.609873 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-6439639f-cf17-4e54-918d-b6417488f240 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:50.611014 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-6439639f-cf17-4e54-918d-b6417488f240 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:50.623142 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6439639f-cf17-4e54-918d-b6417488f240 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:50.623674 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6439639f-cf17-4e54-918d-b6417488f240 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:50.630945 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6439639f-cf17-4e54-918d-b6417488f240 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:50.631395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6439639f-cf17-4e54-918d-b6417488f240 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:50.654491 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-fd7209c2-bdbb-4c3e-8389-847bcd327ea8 req-b7725ea6-0cbc-4b43-84f9-4a71a657e480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12316d28-2975-4c1e-b05b-82a3253bb35f", "name": "network-vif-plugged", "status": "completed", "tag": "8d927002-4a46-4df8-b48a-c6cb84decd8d"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:05:50.666263 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-fd7209c2-bdbb-4c3e-8389-847bcd327ea8 req-b7725ea6-0cbc-4b43-84f9-4a71a657e480 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:50.666795 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-fd7209c2-bdbb-4c3e-8389-847bcd327ea8 req-b7725ea6-0cbc-4b43-84f9-4a71a657e480 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:50.684304 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-fd7209c2-bdbb-4c3e-8389-847bcd327ea8 req-b7725ea6-0cbc-4b43-84f9-4a71a657e480 service nova] Creating event network-vif-plugged:8d927002-4a46-4df8-b48a-c6cb84decd8d for instance 12316d28-2975-4c1e-b05b-82a3253bb35f on hv-cinder-79987 Jul 13 21:05:50.705392 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-fd7209c2-bdbb-4c3e-8389-847bcd327ea8 req-b7725ea6-0cbc-4b43-84f9-4a71a657e480 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054243 Jul 13 21:05:50.706151 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 128/246] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:05:50.724975 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-1986189c-ca4b-40e5-a9ed-00c51b674b66 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:50.729844 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-1986189c-ca4b-40e5-a9ed-00c51b674b66 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:50.746243 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1986189c-ca4b-40e5-a9ed-00c51b674b66 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:50.746942 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1986189c-ca4b-40e5-a9ed-00c51b674b66 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:50.755153 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1986189c-ca4b-40e5-a9ed-00c51b674b66 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:50.756156 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1986189c-ca4b-40e5-a9ed-00c51b674b66 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:50.807403 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=100 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:05:51.006154 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-1986189c-ca4b-40e5-a9ed-00c51b674b66 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:51.016281 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-1986189c-ca4b-40e5-a9ed-00c51b674b66 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:51.017795 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-1986189c-ca4b-40e5-a9ed-00c51b674b66 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:51.019693 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-1986189c-ca4b-40e5-a9ed-00c51b674b66 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.301778 Jul 13 21:05:51.020313 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 129/247] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:50 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:05:51.025521 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-347aae57-da2d-4307-8dc4-53fdefba7596 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:51.026128 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-347aae57-da2d-4307-8dc4-53fdefba7596 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:51.032923 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-347aae57-da2d-4307-8dc4-53fdefba7596 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:51.033794 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-347aae57-da2d-4307-8dc4-53fdefba7596 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:51.035299 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-347aae57-da2d-4307-8dc4-53fdefba7596 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:51.035753 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-347aae57-da2d-4307-8dc4-53fdefba7596 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:51.076058 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-6439639f-cf17-4e54-918d-b6417488f240 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:51.085727 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-6439639f-cf17-4e54-918d-b6417488f240 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1555 microversion: 2.1 time: 0.479880 Jul 13 21:05:51.099564 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 119/248] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:50 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1555 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:51.105880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-dd70b06e-86d5-41df-8d73-507664815b67 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:51.106354 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-dd70b06e-86d5-41df-8d73-507664815b67 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:51.114298 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-dd70b06e-86d5-41df-8d73-507664815b67 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:51.115177 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-dd70b06e-86d5-41df-8d73-507664815b67 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:51.116295 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-dd70b06e-86d5-41df-8d73-507664815b67 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:51.116990 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-dd70b06e-86d5-41df-8d73-507664815b67 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:51.263901 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-347aae57-da2d-4307-8dc4-53fdefba7596 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:51.273124 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-347aae57-da2d-4307-8dc4-53fdefba7596 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.251667 Jul 13 21:05:51.274285 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 130/249] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:51 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:51.357609 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-dd70b06e-86d5-41df-8d73-507664815b67 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.255813 Jul 13 21:05:51.358461 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 120/250] 10.222.0.39 () {58 vars in 1274 bytes} [Wed Jul 13 21:05:51 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f/os-interface => generated 284 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:05:51.384962 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-bcc0875b-4208-4777-a346-f545a3ec0c0e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:51.385558 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-bcc0875b-4208-4777-a346-f545a3ec0c0e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:51.391722 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bcc0875b-4208-4777-a346-f545a3ec0c0e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:51.392167 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bcc0875b-4208-4777-a346-f545a3ec0c0e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:51.393097 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bcc0875b-4208-4777-a346-f545a3ec0c0e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:51.394232 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bcc0875b-4208-4777-a346-f545a3ec0c0e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:51.570534 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-bcc0875b-4208-4777-a346-f545a3ec0c0e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:51.580330 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-bcc0875b-4208-4777-a346-f545a3ec0c0e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.199554 Jul 13 21:05:51.590128 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 131/251] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:51 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:52.040540 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-075e7cb6-f4af-4f08-b65d-00c0f17a43e1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:52.042316 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-075e7cb6-f4af-4f08-b65d-00c0f17a43e1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:52.052686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-075e7cb6-f4af-4f08-b65d-00c0f17a43e1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:52.053504 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-075e7cb6-f4af-4f08-b65d-00c0f17a43e1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:52.054495 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-075e7cb6-f4af-4f08-b65d-00c0f17a43e1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:52.056477 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-075e7cb6-f4af-4f08-b65d-00c0f17a43e1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:52.299494 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-1f47bf8d-5580-4138-ab1b-ff4f451a4816 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:52.299494 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-1f47bf8d-5580-4138-ab1b-ff4f451a4816 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:52.301028 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1f47bf8d-5580-4138-ab1b-ff4f451a4816 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:52.303167 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1f47bf8d-5580-4138-ab1b-ff4f451a4816 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:52.303973 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1f47bf8d-5580-4138-ab1b-ff4f451a4816 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:52.304411 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1f47bf8d-5580-4138-ab1b-ff4f451a4816 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:52.427667 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-075e7cb6-f4af-4f08-b65d-00c0f17a43e1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:52.442207 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-075e7cb6-f4af-4f08-b65d-00c0f17a43e1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:52.443812 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-075e7cb6-f4af-4f08-b65d-00c0f17a43e1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:52.445094 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-075e7cb6-f4af-4f08-b65d-00c0f17a43e1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.411494 Jul 13 21:05:52.457268 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 121/252] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:52 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:52.497552 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-1f47bf8d-5580-4138-ab1b-ff4f451a4816 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:52.505575 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-1f47bf8d-5580-4138-ab1b-ff4f451a4816 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.217577 Jul 13 21:05:52.515871 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 132/253] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:52 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:52.597720 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-65ce39ce-5686-44a3-8fc1-d94a34a209c6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:52.598569 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-65ce39ce-5686-44a3-8fc1-d94a34a209c6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:52.605278 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-65ce39ce-5686-44a3-8fc1-d94a34a209c6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:52.606487 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-65ce39ce-5686-44a3-8fc1-d94a34a209c6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:52.607506 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-65ce39ce-5686-44a3-8fc1-d94a34a209c6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:52.608163 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-65ce39ce-5686-44a3-8fc1-d94a34a209c6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:52.937169 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-65ce39ce-5686-44a3-8fc1-d94a34a209c6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:52.951463 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-65ce39ce-5686-44a3-8fc1-d94a34a209c6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.357296 Jul 13 21:05:52.954649 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 122/254] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:52 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:53.251229 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-5f5c9c86-aaa5-4c2a-9b61-82f178c66be1 req-44bca6e4-bb49-4c17-b2f4-ce35c2e5f2f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52701d54-bab0-4fd7-b5c1-1b0e433d4c9f", "tag": "38f6480c-0bdd-4309-9b91-2e38a86a5d27"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:05:53.263204 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-5f5c9c86-aaa5-4c2a-9b61-82f178c66be1 req-44bca6e4-bb49-4c17-b2f4-ce35c2e5f2f6 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:53.264638 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-5f5c9c86-aaa5-4c2a-9b61-82f178c66be1 req-44bca6e4-bb49-4c17-b2f4-ce35c2e5f2f6 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:53.281516 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-5f5c9c86-aaa5-4c2a-9b61-82f178c66be1 req-44bca6e4-bb49-4c17-b2f4-ce35c2e5f2f6 service nova] Creating event network-changed:38f6480c-0bdd-4309-9b91-2e38a86a5d27 for instance 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f on hv-cinder-79987 Jul 13 21:05:53.288183 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-5f5c9c86-aaa5-4c2a-9b61-82f178c66be1 req-44bca6e4-bb49-4c17-b2f4-ce35c2e5f2f6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040911 Jul 13 21:05:53.289508 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 133/255] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:05:53.465008 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-a16df0aa-9042-4bc2-a38f-c4177472adc5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:53.467116 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-a16df0aa-9042-4bc2-a38f-c4177472adc5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:53.474684 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a16df0aa-9042-4bc2-a38f-c4177472adc5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:53.475738 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a16df0aa-9042-4bc2-a38f-c4177472adc5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:53.476891 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a16df0aa-9042-4bc2-a38f-c4177472adc5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:53.477808 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a16df0aa-9042-4bc2-a38f-c4177472adc5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:53.524198 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-d371865d-6792-4966-a71b-c4d7c961b108 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:53.525625 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-d371865d-6792-4966-a71b-c4d7c961b108 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:53.535895 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d371865d-6792-4966-a71b-c4d7c961b108 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:53.554555 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d371865d-6792-4966-a71b-c4d7c961b108 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:53.558414 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d371865d-6792-4966-a71b-c4d7c961b108 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:53.558950 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d371865d-6792-4966-a71b-c4d7c961b108 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:53.669243 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-a16df0aa-9042-4bc2-a38f-c4177472adc5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:53.681562 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-a16df0aa-9042-4bc2-a38f-c4177472adc5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:53.683119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-a16df0aa-9042-4bc2-a38f-c4177472adc5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:53.685690 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-a16df0aa-9042-4bc2-a38f-c4177472adc5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.223551 Jul 13 21:05:53.687449 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 123/256] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:53 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:53.760778 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-d371865d-6792-4966-a71b-c4d7c961b108 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:53.769564 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-d371865d-6792-4966-a71b-c4d7c961b108 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.249875 Jul 13 21:05:53.779124 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 134/257] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:53 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:53.973620 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-dfbf778b-a60f-4477-8a04-8b3db5ac997c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:53.974234 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-dfbf778b-a60f-4477-8a04-8b3db5ac997c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:53.980482 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-dfbf778b-a60f-4477-8a04-8b3db5ac997c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:53.980993 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-dfbf778b-a60f-4477-8a04-8b3db5ac997c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:53.982305 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-dfbf778b-a60f-4477-8a04-8b3db5ac997c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:53.983097 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-dfbf778b-a60f-4477-8a04-8b3db5ac997c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:54.192419 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-dfbf778b-a60f-4477-8a04-8b3db5ac997c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:54.195945 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=100 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:05:54.201318 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-dfbf778b-a60f-4477-8a04-8b3db5ac997c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.233974 Jul 13 21:05:54.201901 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 124/258] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:53 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:54.704287 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-60cb8a3e-9cbd-4c4f-90a1-a4732635e803 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:54.704895 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-60cb8a3e-9cbd-4c4f-90a1-a4732635e803 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:54.711467 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-60cb8a3e-9cbd-4c4f-90a1-a4732635e803 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:54.711915 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-60cb8a3e-9cbd-4c4f-90a1-a4732635e803 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:54.712669 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-60cb8a3e-9cbd-4c4f-90a1-a4732635e803 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:54.713111 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-60cb8a3e-9cbd-4c4f-90a1-a4732635e803 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:54.786795 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-97b8ef33-6684-4eac-b6d8-c54e7ba95af1 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:54.787402 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-97b8ef33-6684-4eac-b6d8-c54e7ba95af1 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:54.800072 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-97b8ef33-6684-4eac-b6d8-c54e7ba95af1 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:54.800730 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-97b8ef33-6684-4eac-b6d8-c54e7ba95af1 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:54.801496 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-97b8ef33-6684-4eac-b6d8-c54e7ba95af1 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:54.801929 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-97b8ef33-6684-4eac-b6d8-c54e7ba95af1 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:54.849435 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-60cb8a3e-9cbd-4c4f-90a1-a4732635e803 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:54.858338 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-60cb8a3e-9cbd-4c4f-90a1-a4732635e803 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:54.860059 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-60cb8a3e-9cbd-4c4f-90a1-a4732635e803 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:54.861199 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-60cb8a3e-9cbd-4c4f-90a1-a4732635e803 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.160706 Jul 13 21:05:54.861745 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 135/259] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:54 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:54.975806 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-97b8ef33-6684-4eac-b6d8-c54e7ba95af1 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:54.983656 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-97b8ef33-6684-4eac-b6d8-c54e7ba95af1 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1314 microversion: 2.1 time: 0.200938 Jul 13 21:05:54.984260 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 125/260] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:54 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:55.219192 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-397dd492-6e10-4cbf-ae47-69904129b36b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:55.219828 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-397dd492-6e10-4cbf-ae47-69904129b36b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:55.226500 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-397dd492-6e10-4cbf-ae47-69904129b36b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:55.226973 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-397dd492-6e10-4cbf-ae47-69904129b36b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:55.227742 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-397dd492-6e10-4cbf-ae47-69904129b36b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:55.228169 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-397dd492-6e10-4cbf-ae47-69904129b36b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:55.367604 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-397dd492-6e10-4cbf-ae47-69904129b36b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:55.376291 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-397dd492-6e10-4cbf-ae47-69904129b36b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.162164 Jul 13 21:05:55.377435 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 136/261] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:55 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:55.879389 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-6e7e9565-3475-4066-b6e1-00e3a5d3001c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:55.880023 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-6e7e9565-3475-4066-b6e1-00e3a5d3001c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:55.885913 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6e7e9565-3475-4066-b6e1-00e3a5d3001c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:55.886364 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6e7e9565-3475-4066-b6e1-00e3a5d3001c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:55.887152 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6e7e9565-3475-4066-b6e1-00e3a5d3001c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:55.887590 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6e7e9565-3475-4066-b6e1-00e3a5d3001c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:56.000197 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-8f441b23-4660-4ea1-87b3-a502811f5c3b tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:56.001405 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8f441b23-4660-4ea1-87b3-a502811f5c3b tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:56.008115 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8f441b23-4660-4ea1-87b3-a502811f5c3b tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:56.008578 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8f441b23-4660-4ea1-87b3-a502811f5c3b tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:56.009382 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8f441b23-4660-4ea1-87b3-a502811f5c3b tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:56.010388 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8f441b23-4660-4ea1-87b3-a502811f5c3b tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:56.031740 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-6e7e9565-3475-4066-b6e1-00e3a5d3001c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:56.043371 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-6e7e9565-3475-4066-b6e1-00e3a5d3001c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:56.045040 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-6e7e9565-3475-4066-b6e1-00e3a5d3001c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:56.046556 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-6e7e9565-3475-4066-b6e1-00e3a5d3001c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.171151 Jul 13 21:05:56.054685 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 126/262] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:55 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:56.147132 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8f441b23-4660-4ea1-87b3-a502811f5c3b tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:56.162990 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-8f441b23-4660-4ea1-87b3-a502811f5c3b tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1499 microversion: 2.1 time: 0.166617 Jul 13 21:05:56.163605 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 137/263] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:55 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1499 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:56.399462 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-5590f781-3d4b-49b2-a6d7-15bb689e9f77 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:56.400948 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-5590f781-3d4b-49b2-a6d7-15bb689e9f77 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:56.412791 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5590f781-3d4b-49b2-a6d7-15bb689e9f77 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:56.413237 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5590f781-3d4b-49b2-a6d7-15bb689e9f77 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:56.414547 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5590f781-3d4b-49b2-a6d7-15bb689e9f77 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:56.414547 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5590f781-3d4b-49b2-a6d7-15bb689e9f77 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:56.617115 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-5590f781-3d4b-49b2-a6d7-15bb689e9f77 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:56.635475 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-5590f781-3d4b-49b2-a6d7-15bb689e9f77 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.240560 Jul 13 21:05:56.644816 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 127/264] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:56 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:57.067028 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-1062fd81-b049-4c3d-9360-6231f08255e5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:57.067640 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-1062fd81-b049-4c3d-9360-6231f08255e5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:57.076652 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1062fd81-b049-4c3d-9360-6231f08255e5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:57.077081 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1062fd81-b049-4c3d-9360-6231f08255e5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:57.078386 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1062fd81-b049-4c3d-9360-6231f08255e5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:57.079073 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1062fd81-b049-4c3d-9360-6231f08255e5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:57.210333 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-1062fd81-b049-4c3d-9360-6231f08255e5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:57.218172 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-1062fd81-b049-4c3d-9360-6231f08255e5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:57.219638 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-1062fd81-b049-4c3d-9360-6231f08255e5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:57.220725 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-1062fd81-b049-4c3d-9360-6231f08255e5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.157816 Jul 13 21:05:57.221264 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 138/265] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:57 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:05:57.654541 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-3669cbfe-ead2-4770-9640-c468da80046d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:57.655339 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-3669cbfe-ead2-4770-9640-c468da80046d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:57.662083 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3669cbfe-ead2-4770-9640-c468da80046d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:57.662594 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3669cbfe-ead2-4770-9640-c468da80046d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:57.663564 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3669cbfe-ead2-4770-9640-c468da80046d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:57.663979 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3669cbfe-ead2-4770-9640-c468da80046d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:57.687911 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-0a7c3e5f-4033-4edc-81e2-221638abc729 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b0966d7-c88f-4d51-bd89-4eb41e60e3c0"}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:05:57.689142 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-0a7c3e5f-4033-4edc-81e2-221638abc729 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:57.695024 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0a7c3e5f-4033-4edc-81e2-221638abc729 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:57.695463 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0a7c3e5f-4033-4edc-81e2-221638abc729 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:57.696209 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0a7c3e5f-4033-4edc-81e2-221638abc729 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:57.696635 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0a7c3e5f-4033-4edc-81e2-221638abc729 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:57.824670 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-3669cbfe-ead2-4770-9640-c468da80046d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:57.833450 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-3669cbfe-ead2-4770-9640-c468da80046d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.182931 Jul 13 21:05:57.834358 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 128/266] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:57 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:05:58.239701 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-fa3dbd4a-7f42-4025-8a7f-b9705006675b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:58.240288 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-fa3dbd4a-7f42-4025-8a7f-b9705006675b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:58.246288 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fa3dbd4a-7f42-4025-8a7f-b9705006675b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:58.246769 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fa3dbd4a-7f42-4025-8a7f-b9705006675b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:58.247823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fa3dbd4a-7f42-4025-8a7f-b9705006675b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:58.248256 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fa3dbd4a-7f42-4025-8a7f-b9705006675b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:58.441883 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-fa3dbd4a-7f42-4025-8a7f-b9705006675b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:58.468276 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-fa3dbd4a-7f42-4025-8a7f-b9705006675b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:58.474596 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-fa3dbd4a-7f42-4025-8a7f-b9705006675b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:58.476509 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-fa3dbd4a-7f42-4025-8a7f-b9705006675b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.241129 Jul 13 21:05:58.478756 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 129/267] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:58 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:05:58.852248 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-3ff0bb81-4796-4378-9f92-d23d1a49b219 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:58.852867 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-3ff0bb81-4796-4378-9f92-d23d1a49b219 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:58.858732 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3ff0bb81-4796-4378-9f92-d23d1a49b219 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:58.859169 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3ff0bb81-4796-4378-9f92-d23d1a49b219 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:58.859911 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3ff0bb81-4796-4378-9f92-d23d1a49b219 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:58.860333 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3ff0bb81-4796-4378-9f92-d23d1a49b219 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:59.183546 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-0a7c3e5f-4033-4edc-81e2-221638abc729 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "POST /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.499171 Jul 13 21:05:59.189081 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 139/268] 10.222.0.39 () {60 vars in 1322 bytes} [Wed Jul 13 21:05:57 2022] POST /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8/os-volume_attachments => generated 194 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:05:59.402831 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-3ff0bb81-4796-4378-9f92-d23d1a49b219 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:59.410724 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-3ff0bb81-4796-4378-9f92-d23d1a49b219 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.562417 Jul 13 21:05:59.411635 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 130/269] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:05:58 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:05:59.495351 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-faa5b52d-f489-4e82-b56f-5f622f016f20 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:05:59.496041 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-faa5b52d-f489-4e82-b56f-5f622f016f20 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:05:59.504489 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-faa5b52d-f489-4e82-b56f-5f622f016f20 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:59.505320 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-faa5b52d-f489-4e82-b56f-5f622f016f20 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:59.506123 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-faa5b52d-f489-4e82-b56f-5f622f016f20 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:05:59.506684 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-faa5b52d-f489-4e82-b56f-5f622f016f20 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:05:59.656511 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-faa5b52d-f489-4e82-b56f-5f622f016f20 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:59.673689 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-faa5b52d-f489-4e82-b56f-5f622f016f20 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:59.675973 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-faa5b52d-f489-4e82-b56f-5f622f016f20 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:05:59.678703 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-faa5b52d-f489-4e82-b56f-5f622f016f20 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.187941 Jul 13 21:05:59.679463 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 140/270] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:05:59 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:06:00.428801 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0d74837b-cd13-4f74-b3f8-1ce26ccedc99 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:00.429506 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-0d74837b-cd13-4f74-b3f8-1ce26ccedc99 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:00.435648 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0d74837b-cd13-4f74-b3f8-1ce26ccedc99 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:00.436094 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0d74837b-cd13-4f74-b3f8-1ce26ccedc99 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:00.436838 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0d74837b-cd13-4f74-b3f8-1ce26ccedc99 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:00.437263 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0d74837b-cd13-4f74-b3f8-1ce26ccedc99 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:00.574363 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-0d74837b-cd13-4f74-b3f8-1ce26ccedc99 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:00.575335 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-0d74837b-cd13-4f74-b3f8-1ce26ccedc99 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.151420 Jul 13 21:06:00.575971 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 131/271] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:00 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:06:00.696784 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-3eff29fe-c9f0-4880-a552-c634d5d25823 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:00.697434 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-3eff29fe-c9f0-4880-a552-c634d5d25823 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:00.700291 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_api:SELECT=95 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:06:00.705756 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3eff29fe-c9f0-4880-a552-c634d5d25823 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:00.706952 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3eff29fe-c9f0-4880-a552-c634d5d25823 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:00.707743 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3eff29fe-c9f0-4880-a552-c634d5d25823 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:00.708964 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3eff29fe-c9f0-4880-a552-c634d5d25823 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:00.905880 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3eff29fe-c9f0-4880-a552-c634d5d25823 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:00.914899 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3eff29fe-c9f0-4880-a552-c634d5d25823 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:00.917450 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3eff29fe-c9f0-4880-a552-c634d5d25823 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:00.918739 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-3eff29fe-c9f0-4880-a552-c634d5d25823 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.225833 Jul 13 21:06:00.919299 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 141/272] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:06:00 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:06:01.592775 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-f1f90da6-a3a5-406e-bc93-6cdc3cce5964 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:01.593409 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-f1f90da6-a3a5-406e-bc93-6cdc3cce5964 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:01.600175 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f1f90da6-a3a5-406e-bc93-6cdc3cce5964 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:01.600627 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f1f90da6-a3a5-406e-bc93-6cdc3cce5964 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:01.601386 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f1f90da6-a3a5-406e-bc93-6cdc3cce5964 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:01.601817 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f1f90da6-a3a5-406e-bc93-6cdc3cce5964 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:01.773909 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f1f90da6-a3a5-406e-bc93-6cdc3cce5964 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:01.784200 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-f1f90da6-a3a5-406e-bc93-6cdc3cce5964 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.195267 Jul 13 21:06:01.786856 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 132/273] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:01 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:06:01.937275 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-137d2829-da40-47a8-9b89-59439808005d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:01.938059 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-137d2829-da40-47a8-9b89-59439808005d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:01.944717 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-137d2829-da40-47a8-9b89-59439808005d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:01.945245 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-137d2829-da40-47a8-9b89-59439808005d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:01.946041 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-137d2829-da40-47a8-9b89-59439808005d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:01.946476 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-137d2829-da40-47a8-9b89-59439808005d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:02.084387 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-137d2829-da40-47a8-9b89-59439808005d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:02.092131 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-137d2829-da40-47a8-9b89-59439808005d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:02.093609 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-137d2829-da40-47a8-9b89-59439808005d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:02.094746 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-137d2829-da40-47a8-9b89-59439808005d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.161459 Jul 13 21:06:02.095266 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 142/274] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:06:01 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:06:02.803514 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-83927cc7-9fe7-4b6f-b08d-e0941e00d324 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:02.804235 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-83927cc7-9fe7-4b6f-b08d-e0941e00d324 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:02.810103 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-83927cc7-9fe7-4b6f-b08d-e0941e00d324 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:02.810542 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-83927cc7-9fe7-4b6f-b08d-e0941e00d324 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:02.811324 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-83927cc7-9fe7-4b6f-b08d-e0941e00d324 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:02.811745 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-83927cc7-9fe7-4b6f-b08d-e0941e00d324 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:02.942430 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-83927cc7-9fe7-4b6f-b08d-e0941e00d324 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:02.949949 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-83927cc7-9fe7-4b6f-b08d-e0941e00d324 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.150678 Jul 13 21:06:02.950517 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 133/275] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:02 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:06:03.113918 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-42e8e3ac-d1a5-45dd-b10e-2261f0a55a94 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:03.114684 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-42e8e3ac-d1a5-45dd-b10e-2261f0a55a94 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:03.121124 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-42e8e3ac-d1a5-45dd-b10e-2261f0a55a94 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:03.121571 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-42e8e3ac-d1a5-45dd-b10e-2261f0a55a94 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:03.126920 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-42e8e3ac-d1a5-45dd-b10e-2261f0a55a94 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:03.127369 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-42e8e3ac-d1a5-45dd-b10e-2261f0a55a94 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:03.264060 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-42e8e3ac-d1a5-45dd-b10e-2261f0a55a94 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:03.272778 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-42e8e3ac-d1a5-45dd-b10e-2261f0a55a94 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:03.274510 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-42e8e3ac-d1a5-45dd-b10e-2261f0a55a94 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:03.275634 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-42e8e3ac-d1a5-45dd-b10e-2261f0a55a94 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.166425 Jul 13 21:06:03.276191 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 143/276] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:06:03 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:06:03.967280 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-94000266-9d33-4e11-b327-4bc41d0f2789 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:03.967891 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-94000266-9d33-4e11-b327-4bc41d0f2789 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:03.974597 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-94000266-9d33-4e11-b327-4bc41d0f2789 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:03.975069 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-94000266-9d33-4e11-b327-4bc41d0f2789 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:03.975834 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-94000266-9d33-4e11-b327-4bc41d0f2789 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:03.976293 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-94000266-9d33-4e11-b327-4bc41d0f2789 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:04.111969 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-94000266-9d33-4e11-b327-4bc41d0f2789 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:04.119318 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-94000266-9d33-4e11-b327-4bc41d0f2789 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.155896 Jul 13 21:06:04.119877 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 134/277] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:03 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:06:04.293812 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-829b9a10-9358-4189-9af1-5cb5654cb53a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:04.294409 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-829b9a10-9358-4189-9af1-5cb5654cb53a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:04.300790 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-829b9a10-9358-4189-9af1-5cb5654cb53a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:04.301230 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-829b9a10-9358-4189-9af1-5cb5654cb53a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:04.301978 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-829b9a10-9358-4189-9af1-5cb5654cb53a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:04.302405 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-829b9a10-9358-4189-9af1-5cb5654cb53a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:04.432066 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-829b9a10-9358-4189-9af1-5cb5654cb53a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:04.439814 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-829b9a10-9358-4189-9af1-5cb5654cb53a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:04.441316 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-829b9a10-9358-4189-9af1-5cb5654cb53a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:04.442389 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-829b9a10-9358-4189-9af1-5cb5654cb53a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.152419 Jul 13 21:06:04.442962 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 144/278] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:06:04 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:06:04.827093 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-3fb0f3f2-089f-4247-ab2d-1ff508b78a9f req-5150cbbd-b2a2-4668-be99-44c4c5937a10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcbf4753-6006-45d1-af09-33b6f6047153", "name": "network-vif-plugged", "status": "completed", "tag": "f4a4aa3a-af10-49d3-b754-e5211cb6004b"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:06:04.835951 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-3fb0f3f2-089f-4247-ab2d-1ff508b78a9f req-5150cbbd-b2a2-4668-be99-44c4c5937a10 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:04.836513 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-3fb0f3f2-089f-4247-ab2d-1ff508b78a9f req-5150cbbd-b2a2-4668-be99-44c4c5937a10 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:04.848340 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-3fb0f3f2-089f-4247-ab2d-1ff508b78a9f req-5150cbbd-b2a2-4668-be99-44c4c5937a10 service nova] Creating event network-vif-plugged:f4a4aa3a-af10-49d3-b754-e5211cb6004b for instance bcbf4753-6006-45d1-af09-33b6f6047153 on hv-cinder-79987 Jul 13 21:06:04.853157 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-3fb0f3f2-089f-4247-ab2d-1ff508b78a9f req-5150cbbd-b2a2-4668-be99-44c4c5937a10 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030072 Jul 13 21:06:04.853785 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 135/279] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:06:05.135612 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-d78e9429-e83f-4ae2-aaff-72963e34143c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:05.136256 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-d78e9429-e83f-4ae2-aaff-72963e34143c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:05.143012 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d78e9429-e83f-4ae2-aaff-72963e34143c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:05.143456 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d78e9429-e83f-4ae2-aaff-72963e34143c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:05.144204 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d78e9429-e83f-4ae2-aaff-72963e34143c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:05.144625 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d78e9429-e83f-4ae2-aaff-72963e34143c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:05.148832 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:06:05.285854 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-d78e9429-e83f-4ae2-aaff-72963e34143c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:05.301160 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-d78e9429-e83f-4ae2-aaff-72963e34143c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.169324 Jul 13 21:06:05.301816 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 145/280] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:05 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:06:05.460766 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0017ccf2-7eb6-499a-b2ac-a721b558335a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:05.461865 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-0017ccf2-7eb6-499a-b2ac-a721b558335a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:05.470298 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0017ccf2-7eb6-499a-b2ac-a721b558335a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:05.471043 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0017ccf2-7eb6-499a-b2ac-a721b558335a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:05.472333 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0017ccf2-7eb6-499a-b2ac-a721b558335a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:05.472830 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0017ccf2-7eb6-499a-b2ac-a721b558335a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:05.622354 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-0017ccf2-7eb6-499a-b2ac-a721b558335a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:05.632272 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-0017ccf2-7eb6-499a-b2ac-a721b558335a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:05.634149 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-0017ccf2-7eb6-499a-b2ac-a721b558335a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:05.635523 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-0017ccf2-7eb6-499a-b2ac-a721b558335a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1406 microversion: 2.20 time: 0.179089 Jul 13 21:06:05.636779 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 136/281] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:06:05 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:06:06.318321 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-08f6c3f7-97b4-4a19-af3a-4c8ce89580c0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:06.318956 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-08f6c3f7-97b4-4a19-af3a-4c8ce89580c0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:06.325658 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-08f6c3f7-97b4-4a19-af3a-4c8ce89580c0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:06.326098 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-08f6c3f7-97b4-4a19-af3a-4c8ce89580c0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:06.326873 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-08f6c3f7-97b4-4a19-af3a-4c8ce89580c0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:06.327298 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-08f6c3f7-97b4-4a19-af3a-4c8ce89580c0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:06.461322 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-08f6c3f7-97b4-4a19-af3a-4c8ce89580c0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:06.469544 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-08f6c3f7-97b4-4a19-af3a-4c8ce89580c0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.156061 Jul 13 21:06:06.470099 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 146/282] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:06 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:06:06.654735 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-802fd020-d01c-4e20-afa2-16fb0998e222 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:06.656008 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-802fd020-d01c-4e20-afa2-16fb0998e222 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:06.658208 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_api:SELECT=86 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:06:06.663761 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-802fd020-d01c-4e20-afa2-16fb0998e222 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:06.664234 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-802fd020-d01c-4e20-afa2-16fb0998e222 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:06.665022 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-802fd020-d01c-4e20-afa2-16fb0998e222 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:06.665489 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-802fd020-d01c-4e20-afa2-16fb0998e222 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:06.802742 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-802fd020-d01c-4e20-afa2-16fb0998e222 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:06.817614 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-802fd020-d01c-4e20-afa2-16fb0998e222 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:06.819378 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-802fd020-d01c-4e20-afa2-16fb0998e222 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:06.820612 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-802fd020-d01c-4e20-afa2-16fb0998e222 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1598 microversion: 2.20 time: 0.169622 Jul 13 21:06:06.821288 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 137/283] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:06:06 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1598 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:06:06.840153 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-f3f92b1a-a677-43e0-b6c1-7886b829d2fb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:06.840881 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-f3f92b1a-a677-43e0-b6c1-7886b829d2fb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:06.848330 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f3f92b1a-a677-43e0-b6c1-7886b829d2fb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:06.848983 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f3f92b1a-a677-43e0-b6c1-7886b829d2fb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:06.850113 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f3f92b1a-a677-43e0-b6c1-7886b829d2fb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:06.850741 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f3f92b1a-a677-43e0-b6c1-7886b829d2fb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:06.933355 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-f3f92b1a-a677-43e0-b6c1-7886b829d2fb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.098456 Jul 13 21:06:06.934186 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 147/284] 10.222.0.39 () {60 vars in 1315 bytes} [Wed Jul 13 21:06:06 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 21:06:07.487718 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b9c11560-1b15-4fa3-a5b9-ac9c7f45ee0e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:07.488390 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b9c11560-1b15-4fa3-a5b9-ac9c7f45ee0e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:07.496273 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b9c11560-1b15-4fa3-a5b9-ac9c7f45ee0e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:07.496809 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b9c11560-1b15-4fa3-a5b9-ac9c7f45ee0e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:07.497599 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b9c11560-1b15-4fa3-a5b9-ac9c7f45ee0e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:07.498035 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b9c11560-1b15-4fa3-a5b9-ac9c7f45ee0e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:07.657223 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b9c11560-1b15-4fa3-a5b9-ac9c7f45ee0e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:07.669431 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b9c11560-1b15-4fa3-a5b9-ac9c7f45ee0e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.185591 Jul 13 21:06:07.670193 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 138/285] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:07 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:06:08.327587 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-dcc062f2-62a5-4cbd-a27d-ac0573a797fb req-65ffea0d-d25f-418e-ad72-ca33d1fb2c9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12316d28-2975-4c1e-b05b-82a3253bb35f", "tag": "8d927002-4a46-4df8-b48a-c6cb84decd8d"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:06:08.337266 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-dcc062f2-62a5-4cbd-a27d-ac0573a797fb req-65ffea0d-d25f-418e-ad72-ca33d1fb2c9c service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:08.337703 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-dcc062f2-62a5-4cbd-a27d-ac0573a797fb req-65ffea0d-d25f-418e-ad72-ca33d1fb2c9c service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:08.350980 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-dcc062f2-62a5-4cbd-a27d-ac0573a797fb req-65ffea0d-d25f-418e-ad72-ca33d1fb2c9c service nova] Creating event network-changed:8d927002-4a46-4df8-b48a-c6cb84decd8d for instance 12316d28-2975-4c1e-b05b-82a3253bb35f on hv-cinder-79987 Jul 13 21:06:08.355972 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-dcc062f2-62a5-4cbd-a27d-ac0573a797fb req-65ffea0d-d25f-418e-ad72-ca33d1fb2c9c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033840 Jul 13 21:06:08.356919 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 148/286] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:06:08.688186 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-90aadb14-3f2b-40e4-9dad-047fa0708d88 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:08.689126 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-90aadb14-3f2b-40e4-9dad-047fa0708d88 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:08.695757 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-90aadb14-3f2b-40e4-9dad-047fa0708d88 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:08.696276 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-90aadb14-3f2b-40e4-9dad-047fa0708d88 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:08.697059 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-90aadb14-3f2b-40e4-9dad-047fa0708d88 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:08.697481 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-90aadb14-3f2b-40e4-9dad-047fa0708d88 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:08.842080 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-90aadb14-3f2b-40e4-9dad-047fa0708d88 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:08.851920 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-90aadb14-3f2b-40e4-9dad-047fa0708d88 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1362 microversion: 2.1 time: 0.167868 Jul 13 21:06:08.852740 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 139/287] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:08 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:06:09.873392 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-46d52fd0-f61e-43e7-9522-33eed39c0cee tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:09.874074 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-46d52fd0-f61e-43e7-9522-33eed39c0cee tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:09.880243 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-46d52fd0-f61e-43e7-9522-33eed39c0cee tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:09.880681 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-46d52fd0-f61e-43e7-9522-33eed39c0cee tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:09.881426 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-46d52fd0-f61e-43e7-9522-33eed39c0cee tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:09.881848 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-46d52fd0-f61e-43e7-9522-33eed39c0cee tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:10.045915 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-46d52fd0-f61e-43e7-9522-33eed39c0cee tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:10.054495 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-46d52fd0-f61e-43e7-9522-33eed39c0cee tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1548 microversion: 2.1 time: 0.188394 Jul 13 21:06:10.055093 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 149/288] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:09 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1548 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:06:10.071667 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b52d6468-f105-45c2-b936-bd26e7e54417 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:10.072737 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b52d6468-f105-45c2-b936-bd26e7e54417 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:10.080418 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b52d6468-f105-45c2-b936-bd26e7e54417 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:10.081686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b52d6468-f105-45c2-b936-bd26e7e54417 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:10.082896 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b52d6468-f105-45c2-b936-bd26e7e54417 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:10.083528 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b52d6468-f105-45c2-b936-bd26e7e54417 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:10.185779 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b52d6468-f105-45c2-b936-bd26e7e54417 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117960 Jul 13 21:06:10.186547 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 140/289] 10.222.0.39 () {58 vars in 1274 bytes} [Wed Jul 13 21:06:10 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:06:11.167237 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-ba880524-c179-45de-a7c3-0e47e4cc842e req-25d15900-866f-4b09-8858-b2c84b491670 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcbf4753-6006-45d1-af09-33b6f6047153", "tag": "f4a4aa3a-af10-49d3-b754-e5211cb6004b"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:06:11.184794 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-ba880524-c179-45de-a7c3-0e47e4cc842e req-25d15900-866f-4b09-8858-b2c84b491670 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:11.185152 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-ba880524-c179-45de-a7c3-0e47e4cc842e req-25d15900-866f-4b09-8858-b2c84b491670 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:11.197757 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-ba880524-c179-45de-a7c3-0e47e4cc842e req-25d15900-866f-4b09-8858-b2c84b491670 service nova] Creating event network-changed:f4a4aa3a-af10-49d3-b754-e5211cb6004b for instance bcbf4753-6006-45d1-af09-33b6f6047153 on hv-cinder-79987 Jul 13 21:06:11.204099 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-ba880524-c179-45de-a7c3-0e47e4cc842e req-25d15900-866f-4b09-8858-b2c84b491670 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039486 Jul 13 21:06:11.204099 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 150/290] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:06:17.541405 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-417c58f3-3c5f-4972-a00a-56a64d268340 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:17.541892 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-417c58f3-3c5f-4972-a00a-56a64d268340 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:17.548125 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-417c58f3-3c5f-4972-a00a-56a64d268340 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:17.548571 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-417c58f3-3c5f-4972-a00a-56a64d268340 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:17.549890 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-417c58f3-3c5f-4972-a00a-56a64d268340 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:17.550319 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-417c58f3-3c5f-4972-a00a-56a64d268340 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:17.577630 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-417c58f3-3c5f-4972-a00a-56a64d268340 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Going to try to terminate instance {{(pid=118444) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 21:06:17.610431 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=100 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:06:17.680965 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-417c58f3-3c5f-4972-a00a-56a64d268340 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 204 len: 0 microversion: 2.1 time: 0.143196 Jul 13 21:06:17.681673 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 141/291] 10.222.0.39 () {58 vars in 1238 bytes} [Wed Jul 13 21:06:17 2022] DELETE /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 21:06:17.690783 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-194ceeb0-c92f-48a1-8e5c-d0e18eac7ddb tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:17.691576 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-194ceeb0-c92f-48a1-8e5c-d0e18eac7ddb tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:17.697840 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-194ceeb0-c92f-48a1-8e5c-d0e18eac7ddb tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:17.698367 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-194ceeb0-c92f-48a1-8e5c-d0e18eac7ddb tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:17.699301 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-194ceeb0-c92f-48a1-8e5c-d0e18eac7ddb tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:17.699825 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-194ceeb0-c92f-48a1-8e5c-d0e18eac7ddb tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:17.840729 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-194ceeb0-c92f-48a1-8e5c-d0e18eac7ddb tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:17.849285 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-194ceeb0-c92f-48a1-8e5c-d0e18eac7ddb tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1551 microversion: 2.1 time: 0.163341 Jul 13 21:06:17.849847 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 151/292] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:17 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1551 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:06:18.867154 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-3e9fc4e9-613f-4620-98ae-e248f30667f9 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:18.867845 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-3e9fc4e9-613f-4620-98ae-e248f30667f9 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:18.875222 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3e9fc4e9-613f-4620-98ae-e248f30667f9 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:18.875850 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3e9fc4e9-613f-4620-98ae-e248f30667f9 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:18.876465 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3e9fc4e9-613f-4620-98ae-e248f30667f9 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:18.877075 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3e9fc4e9-613f-4620-98ae-e248f30667f9 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:19.052199 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-3e9fc4e9-613f-4620-98ae-e248f30667f9 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:19.060791 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-3e9fc4e9-613f-4620-98ae-e248f30667f9 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1551 microversion: 2.1 time: 0.197737 Jul 13 21:06:19.061359 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 142/293] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:18 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1551 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:06:20.077726 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-5e1f1364-11b3-461a-b566-22e69ae413d9 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:20.078332 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-5e1f1364-11b3-461a-b566-22e69ae413d9 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:20.085593 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5e1f1364-11b3-461a-b566-22e69ae413d9 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:20.086036 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5e1f1364-11b3-461a-b566-22e69ae413d9 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:20.086985 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5e1f1364-11b3-461a-b566-22e69ae413d9 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:20.087418 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5e1f1364-11b3-461a-b566-22e69ae413d9 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:20.217393 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5e1f1364-11b3-461a-b566-22e69ae413d9 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:20.225965 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-5e1f1364-11b3-461a-b566-22e69ae413d9 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1551 microversion: 2.1 time: 0.152279 Jul 13 21:06:20.226522 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 152/294] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:20 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1551 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:06:21.243623 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-48358c0b-12b0-49c4-9b80-20b901d0573d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:21.245462 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-48358c0b-12b0-49c4-9b80-20b901d0573d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:21.254094 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-48358c0b-12b0-49c4-9b80-20b901d0573d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:21.254557 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-48358c0b-12b0-49c4-9b80-20b901d0573d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:21.255342 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-48358c0b-12b0-49c4-9b80-20b901d0573d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:21.255776 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-48358c0b-12b0-49c4-9b80-20b901d0573d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:21.393210 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-48358c0b-12b0-49c4-9b80-20b901d0573d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:21.401958 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-48358c0b-12b0-49c4-9b80-20b901d0573d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1551 microversion: 2.1 time: 0.162968 Jul 13 21:06:21.402528 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 143/295] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:21 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1551 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:06:22.418603 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-075ffc6f-8fe7-4330-a128-4aa6d399dbed tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:22.419295 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-075ffc6f-8fe7-4330-a128-4aa6d399dbed tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:22.425707 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-075ffc6f-8fe7-4330-a128-4aa6d399dbed tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:22.426145 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-075ffc6f-8fe7-4330-a128-4aa6d399dbed tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:22.426916 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-075ffc6f-8fe7-4330-a128-4aa6d399dbed tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:22.427341 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-075ffc6f-8fe7-4330-a128-4aa6d399dbed tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:22.551980 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-075ffc6f-8fe7-4330-a128-4aa6d399dbed tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:22.559788 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-075ffc6f-8fe7-4330-a128-4aa6d399dbed tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1551 microversion: 2.1 time: 0.145031 Jul 13 21:06:22.560341 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 153/296] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:22 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1551 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:06:23.577139 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-f99e7663-c648-4d44-8f24-ad79c7817f87 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:23.577887 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-f99e7663-c648-4d44-8f24-ad79c7817f87 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:23.584328 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f99e7663-c648-4d44-8f24-ad79c7817f87 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:23.584843 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f99e7663-c648-4d44-8f24-ad79c7817f87 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:23.585651 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f99e7663-c648-4d44-8f24-ad79c7817f87 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:23.586147 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f99e7663-c648-4d44-8f24-ad79c7817f87 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:23.719951 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f99e7663-c648-4d44-8f24-ad79c7817f87 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:23.729018 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-f99e7663-c648-4d44-8f24-ad79c7817f87 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1551 microversion: 2.1 time: 0.155687 Jul 13 21:06:23.729590 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 144/297] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:23 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1551 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:06:24.745155 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-3b1e35e3-ebfb-4cfb-a53e-4b96daa2092f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:24.745747 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-3b1e35e3-ebfb-4cfb-a53e-4b96daa2092f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:24.752113 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3b1e35e3-ebfb-4cfb-a53e-4b96daa2092f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:24.752574 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3b1e35e3-ebfb-4cfb-a53e-4b96daa2092f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:24.753299 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3b1e35e3-ebfb-4cfb-a53e-4b96daa2092f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:24.753722 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3b1e35e3-ebfb-4cfb-a53e-4b96daa2092f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:24.883731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3b1e35e3-ebfb-4cfb-a53e-4b96daa2092f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:24.891736 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-3b1e35e3-ebfb-4cfb-a53e-4b96daa2092f tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1551 microversion: 2.1 time: 0.150443 Jul 13 21:06:24.892282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 154/298] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:24 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1551 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:06:25.908626 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0e64936b-fe64-40cb-91ab-5e2c2a7423ef tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:25.909248 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-0e64936b-fe64-40cb-91ab-5e2c2a7423ef tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:25.915357 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0e64936b-fe64-40cb-91ab-5e2c2a7423ef tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:25.915797 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0e64936b-fe64-40cb-91ab-5e2c2a7423ef tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:25.916546 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0e64936b-fe64-40cb-91ab-5e2c2a7423ef tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:25.916974 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0e64936b-fe64-40cb-91ab-5e2c2a7423ef tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:26.045808 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-0e64936b-fe64-40cb-91ab-5e2c2a7423ef tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:26.054264 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-0e64936b-fe64-40cb-91ab-5e2c2a7423ef tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1551 microversion: 2.1 time: 0.149308 Jul 13 21:06:26.054883 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 145/299] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:25 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1551 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:06:27.071778 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-e192e60d-a9ae-4f1a-b949-65d69314a724 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:27.072374 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-e192e60d-a9ae-4f1a-b949-65d69314a724 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:27.078783 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e192e60d-a9ae-4f1a-b949-65d69314a724 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:27.079223 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e192e60d-a9ae-4f1a-b949-65d69314a724 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:27.079970 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e192e60d-a9ae-4f1a-b949-65d69314a724 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:27.080400 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e192e60d-a9ae-4f1a-b949-65d69314a724 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:27.203949 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-e192e60d-a9ae-4f1a-b949-65d69314a724 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:27.212317 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-e192e60d-a9ae-4f1a-b949-65d69314a724 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1551 microversion: 2.1 time: 0.144364 Jul 13 21:06:27.212871 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 155/300] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:27 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1551 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:06:28.229294 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-d6e46e58-5053-43d4-889b-0d32892d4fce tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:28.229817 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-d6e46e58-5053-43d4-889b-0d32892d4fce tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:28.235823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d6e46e58-5053-43d4-889b-0d32892d4fce tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:28.236260 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d6e46e58-5053-43d4-889b-0d32892d4fce tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:28.236999 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d6e46e58-5053-43d4-889b-0d32892d4fce tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:28.237466 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d6e46e58-5053-43d4-889b-0d32892d4fce tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:28.367496 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-d6e46e58-5053-43d4-889b-0d32892d4fce tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:28.375404 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-d6e46e58-5053-43d4-889b-0d32892d4fce tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1551 microversion: 2.1 time: 0.150001 Jul 13 21:06:28.375954 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 146/301] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:28 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1551 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:06:29.394786 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-a8149ea5-e84f-45d6-8463-ac88e3cc1665 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:29.395490 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-a8149ea5-e84f-45d6-8463-ac88e3cc1665 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:29.402107 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a8149ea5-e84f-45d6-8463-ac88e3cc1665 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:29.402548 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a8149ea5-e84f-45d6-8463-ac88e3cc1665 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:29.403335 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a8149ea5-e84f-45d6-8463-ac88e3cc1665 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:29.403761 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a8149ea5-e84f-45d6-8463-ac88e3cc1665 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:29.541135 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-a8149ea5-e84f-45d6-8463-ac88e3cc1665 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:29.551358 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-a8149ea5-e84f-45d6-8463-ac88e3cc1665 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1551 microversion: 2.1 time: 0.159329 Jul 13 21:06:29.560879 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 156/302] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:29 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1551 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:06:29.712467 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-9fa9a910-1d20-4fb2-8d31-e9a516007ffe req-81b74d50-1fb6-496c-9834-23fce1c59f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ed35cd9-7632-4570-b17d-c08b19ed09d8", "name": "network-vif-deleted", "tag": "2fcd8530-2884-4c9c-a739-6fbe50c8a3ff"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:06:29.721339 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-9fa9a910-1d20-4fb2-8d31-e9a516007ffe req-81b74d50-1fb6-496c-9834-23fce1c59f2d service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:29.722567 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-9fa9a910-1d20-4fb2-8d31-e9a516007ffe req-81b74d50-1fb6-496c-9834-23fce1c59f2d service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:29.734573 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-9fa9a910-1d20-4fb2-8d31-e9a516007ffe req-81b74d50-1fb6-496c-9834-23fce1c59f2d service nova] Creating event network-vif-deleted:2fcd8530-2884-4c9c-a739-6fbe50c8a3ff for instance 8ed35cd9-7632-4570-b17d-c08b19ed09d8 on hv-cinder-79987 Jul 13 21:06:29.740008 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-9fa9a910-1d20-4fb2-8d31-e9a516007ffe req-81b74d50-1fb6-496c-9834-23fce1c59f2d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031104 Jul 13 21:06:29.740534 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 147/303] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:06:30.568296 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-46c7da59-c467-437e-bd29-deeba1aadcf7 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:30.568927 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-46c7da59-c467-437e-bd29-deeba1aadcf7 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:30.575471 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-46c7da59-c467-437e-bd29-deeba1aadcf7 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:30.575919 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-46c7da59-c467-437e-bd29-deeba1aadcf7 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:30.576678 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-46c7da59-c467-437e-bd29-deeba1aadcf7 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:30.577110 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-46c7da59-c467-437e-bd29-deeba1aadcf7 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:30.606462 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-46c7da59-c467-437e-bd29-deeba1aadcf7 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:30.606930 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-46c7da59-c467-437e-bd29-deeba1aadcf7 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:30.607378 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.objects.instance [None req-46c7da59-c467-437e-bd29-deeba1aadcf7 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lazy-loading 'fault' on Instance uuid 8ed35cd9-7632-4570-b17d-c08b19ed09d8 {{(pid=118445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:06:30.651657 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-46c7da59-c467-437e-bd29-deeba1aadcf7 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:30.659253 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-46c7da59-c467-437e-bd29-deeba1aadcf7 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1350 microversion: 2.1 time: 0.095363 Jul 13 21:06:30.659828 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 157/304] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:30 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:06:31.675818 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-c01c9db9-029c-4e80-b5e4-d78d07f11ee8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:31.676497 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-c01c9db9-029c-4e80-b5e4-d78d07f11ee8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:31.682841 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c01c9db9-029c-4e80-b5e4-d78d07f11ee8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:31.683372 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c01c9db9-029c-4e80-b5e4-d78d07f11ee8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:31.684140 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c01c9db9-029c-4e80-b5e4-d78d07f11ee8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:31.684578 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c01c9db9-029c-4e80-b5e4-d78d07f11ee8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:31.716051 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c01c9db9-029c-4e80-b5e4-d78d07f11ee8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:31.716507 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c01c9db9-029c-4e80-b5e4-d78d07f11ee8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:31.716960 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.objects.instance [None req-c01c9db9-029c-4e80-b5e4-d78d07f11ee8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lazy-loading 'fault' on Instance uuid 8ed35cd9-7632-4570-b17d-c08b19ed09d8 {{(pid=118444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:06:31.765402 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-c01c9db9-029c-4e80-b5e4-d78d07f11ee8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:31.774289 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-c01c9db9-029c-4e80-b5e4-d78d07f11ee8 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1350 microversion: 2.1 time: 0.102501 Jul 13 21:06:31.774906 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 148/305] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:31 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:06:32.791687 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-d3982496-a497-4b27-b154-a06beeb11e82 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:32.792320 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-d3982496-a497-4b27-b154-a06beeb11e82 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:32.794776 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_api:SELECT=36 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:06:32.803405 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d3982496-a497-4b27-b154-a06beeb11e82 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:32.803851 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d3982496-a497-4b27-b154-a06beeb11e82 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:32.804617 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d3982496-a497-4b27-b154-a06beeb11e82 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:32.805054 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d3982496-a497-4b27-b154-a06beeb11e82 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:32.834682 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d3982496-a497-4b27-b154-a06beeb11e82 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:32.835203 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d3982496-a497-4b27-b154-a06beeb11e82 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:32.835666 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.objects.instance [None req-d3982496-a497-4b27-b154-a06beeb11e82 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lazy-loading 'fault' on Instance uuid 8ed35cd9-7632-4570-b17d-c08b19ed09d8 {{(pid=118445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:06:32.875208 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-d3982496-a497-4b27-b154-a06beeb11e82 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:32.883725 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-d3982496-a497-4b27-b154-a06beeb11e82 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1350 microversion: 2.1 time: 0.095821 Jul 13 21:06:32.884282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 158/306] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:32 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:06:33.900898 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-728394e2-a6d6-4441-a203-9065be5e4d3d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:33.901623 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-728394e2-a6d6-4441-a203-9065be5e4d3d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:33.907680 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-728394e2-a6d6-4441-a203-9065be5e4d3d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:33.908201 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-728394e2-a6d6-4441-a203-9065be5e4d3d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:33.909500 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-728394e2-a6d6-4441-a203-9065be5e4d3d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:33.910146 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-728394e2-a6d6-4441-a203-9065be5e4d3d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:33.942789 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-728394e2-a6d6-4441-a203-9065be5e4d3d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:33.943226 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-728394e2-a6d6-4441-a203-9065be5e4d3d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:33.943670 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.objects.instance [None req-728394e2-a6d6-4441-a203-9065be5e4d3d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lazy-loading 'fault' on Instance uuid 8ed35cd9-7632-4570-b17d-c08b19ed09d8 {{(pid=118444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:06:33.984720 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-728394e2-a6d6-4441-a203-9065be5e4d3d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:33.992818 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-728394e2-a6d6-4441-a203-9065be5e4d3d tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1350 microversion: 2.1 time: 0.095896 Jul 13 21:06:33.993373 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 149/307] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:33 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:06:35.010092 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-a10d3915-5321-4853-8b33-dadacf976258 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:35.010815 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-a10d3915-5321-4853-8b33-dadacf976258 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:35.017570 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a10d3915-5321-4853-8b33-dadacf976258 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:35.018055 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a10d3915-5321-4853-8b33-dadacf976258 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:35.018860 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a10d3915-5321-4853-8b33-dadacf976258 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:35.019294 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a10d3915-5321-4853-8b33-dadacf976258 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:35.050158 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a10d3915-5321-4853-8b33-dadacf976258 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:35.050597 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a10d3915-5321-4853-8b33-dadacf976258 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:35.051056 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.objects.instance [None req-a10d3915-5321-4853-8b33-dadacf976258 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lazy-loading 'fault' on Instance uuid 8ed35cd9-7632-4570-b17d-c08b19ed09d8 {{(pid=118445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:06:35.108102 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-a10d3915-5321-4853-8b33-dadacf976258 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:35.116471 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-a10d3915-5321-4853-8b33-dadacf976258 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1350 microversion: 2.1 time: 0.110235 Jul 13 21:06:35.117034 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 159/308] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:35 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1350 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:06:36.133034 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-fc14157f-c8c7-49bb-ad6a-a80f8950e6cc tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:36.133866 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-fc14157f-c8c7-49bb-ad6a-a80f8950e6cc tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:36.139933 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fc14157f-c8c7-49bb-ad6a-a80f8950e6cc tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:36.143262 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fc14157f-c8c7-49bb-ad6a-a80f8950e6cc tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:36.143262 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fc14157f-c8c7-49bb-ad6a-a80f8950e6cc tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:36.143262 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fc14157f-c8c7-49bb-ad6a-a80f8950e6cc tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:36.172408 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fc14157f-c8c7-49bb-ad6a-a80f8950e6cc tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:36.172888 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fc14157f-c8c7-49bb-ad6a-a80f8950e6cc tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:36.173334 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.objects.instance [None req-fc14157f-c8c7-49bb-ad6a-a80f8950e6cc tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lazy-loading 'fault' on Instance uuid 8ed35cd9-7632-4570-b17d-c08b19ed09d8 {{(pid=118444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:06:36.215370 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-fc14157f-c8c7-49bb-ad6a-a80f8950e6cc tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28051d0f956461c8f3b39825e33af96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb5da85f8a74b08aef7b37cc209ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:36.223849 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-fc14157f-c8c7-49bb-ad6a-a80f8950e6cc tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 200 len: 1350 microversion: 2.1 time: 0.094563 Jul 13 21:06:36.224408 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 150/309] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:36 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:06:37.240776 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-61691754-4fea-4c1d-949d-f655a59c63c5 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:37.241378 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-61691754-4fea-4c1d-949d-f655a59c63c5 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:37.247988 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-61691754-4fea-4c1d-949d-f655a59c63c5 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:37.248319 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-61691754-4fea-4c1d-949d-f655a59c63c5 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:37.249072 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-61691754-4fea-4c1d-949d-f655a59c63c5 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:37.249504 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-61691754-4fea-4c1d-949d-f655a59c63c5 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:37.254786 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=85 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:06:37.264424 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.wsgi [None req-61691754-4fea-4c1d-949d-f655a59c63c5 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] HTTP exception thrown: Instance 8ed35cd9-7632-4570-b17d-c08b19ed09d8 could not be found. Jul 13 21:06:37.268929 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-61691754-4fea-4c1d-949d-f655a59c63c5 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Request method failure captured: Jul 13 21:06:37.268929 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: request: GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 HTTP/1.1 Jul 13 21:06:37.268929 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept: application/json Jul 13 21:06:37.268929 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept-Encoding: identity Jul 13 21:06:37.268929 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Connection: close Jul 13 21:06:37.268929 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Length: 0 Jul 13 21:06:37.268929 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Type: application/json Jul 13 21:06:37.268929 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Host: 10.222.0.39 Jul 13 21:06:37.268929 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Openstack-System-Scope: None Jul 13 21:06:37.268929 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: User-Agent: python-urllib3/1.26.9 Jul 13 21:06:37.268929 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Auth-Token: gAAAAABizzNuomAumwNPUgBSwGm_U0XkrTJliQLyRPgCRxNGHtIl0FIel-et7aYiOFm-QodSeqeZgoA8Xsm7DpnN4ZeB1CvTXE28FoLpzzQBE2LhyR77fu6ScnhuDmeni1eODvqoCMHeBKtaKFtF6fWJvC4QK9r0DAwC4p4i6i6AVoomER1DpcM Jul 13 21:06:37.268929 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Id: None Jul 13 21:06:37.268929 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Name: None Jul 13 21:06:37.268929 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Identity-Status: Confirmed Jul 13 21:06:37.268929 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Is-Admin-Project: True Jul 13 21:06:37.268929 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Id: default Jul 13 21:06:37.268929 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Name: Default Jul 13 21:06:37.268929 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Id: 9eb5da85f8a74b08aef7b37cc209ca92 Jul 13 21:06:37.268929 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Name: tempest-DeleteServersTestJSON-140957177 Jul 13 21:06:37.268929 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Role: member,reader Jul 13 21:06:37.268929 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Roles: member,reader Jul 13 21:06:37.270152 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9eb5da85f8a74b08aef7b37cc209ca92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9eb5da85f8a74b08aef7b37cc209ca92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9eb5da85f8a74b08aef7b37cc209ca92", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9eb5da85f8a74b08aef7b37cc209ca92"}]}] Jul 13 21:06:37.270152 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant: tempest-DeleteServersTestJSON-140957177 Jul 13 21:06:37.270152 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Id: 9eb5da85f8a74b08aef7b37cc209ca92 Jul 13 21:06:37.270152 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Name: tempest-DeleteServersTestJSON-140957177 Jul 13 21:06:37.270152 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User: tempest-DeleteServersTestJSON-140957177-project Jul 13 21:06:37.270152 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Id: default Jul 13 21:06:37.270152 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Name: Default Jul 13 21:06:37.270152 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Id: a28051d0f956461c8f3b39825e33af96 Jul 13 21:06:37.270152 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Name: tempest-DeleteServersTestJSON-140957177-project Jul 13 21:06:37.270152 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: method: > Jul 13 21:06:37.270152 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: exception: Instance 8ed35cd9-7632-4570-b17d-c08b19ed09d8 could not be found. Jul 13 21:06:37.270152 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: action_args: {'id': '8ed35cd9-7632-4570-b17d-c08b19ed09d8'} Jul 13 21:06:37.270877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:06:37.270877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:06:37.270877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:06:37.270877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:06:37.270877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:06:37.270877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:06:37.270877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:06:37.270877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:06:37.270877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:06:37.270877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:06:37.270877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ed35cd9-7632-4570-b17d-c08b19ed09d8 could not be found. Jul 13 21:06:37.270877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:06:37.270877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:06:37.270877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:06:37.270877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:06:37.270877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:06:37.270877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:06:37.270877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:06:37.270877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:06:37.270877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:06:37.272711 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:06:37.272711 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 21:06:37.272711 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 21:06:37.272711 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:06:37.272711 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:06:37.272711 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:06:37.272711 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:06:37.272711 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ed35cd9-7632-4570-b17d-c08b19ed09d8 could not be found. Jul 13 21:06:37.272711 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:06:37.272711 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:06:37.272711 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:06:37.272711 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:06:37.272711 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:06:37.272711 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:06:37.272711 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:06:37.272711 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:06:37.272711 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ed35cd9-7632-4570-b17d-c08b19ed09d8 could not be found. Jul 13 21:06:37.272711 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:06:37.273944 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-61691754-4fea-4c1d-949d-f655a59c63c5 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Returning 404 to user: Instance 8ed35cd9-7632-4570-b17d-c08b19ed09d8 could not be found. {{(pid=118445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:06:37.273944 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-61691754-4fea-4c1d-949d-f655a59c63c5 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 404 len: 111 microversion: 2.1 time: 0.033867 Jul 13 21:06:37.273944 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 160/310] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:37 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:06:37.373935 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-1783cc2e-40bf-4963-ae9e-1f417c8268fc tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:37.374913 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-1783cc2e-40bf-4963-ae9e-1f417c8268fc tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:37.376860 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:06:37.383285 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1783cc2e-40bf-4963-ae9e-1f417c8268fc tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:37.383735 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1783cc2e-40bf-4963-ae9e-1f417c8268fc tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:37.384495 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1783cc2e-40bf-4963-ae9e-1f417c8268fc tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:37.384934 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1783cc2e-40bf-4963-ae9e-1f417c8268fc tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:37.398206 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.wsgi [None req-1783cc2e-40bf-4963-ae9e-1f417c8268fc tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] HTTP exception thrown: Instance 8ed35cd9-7632-4570-b17d-c08b19ed09d8 could not be found. Jul 13 21:06:37.407952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-1783cc2e-40bf-4963-ae9e-1f417c8268fc tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Request method failure captured: Jul 13 21:06:37.407952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: request: GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8/os-volume_attachments HTTP/1.1 Jul 13 21:06:37.407952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept: application/json Jul 13 21:06:37.407952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept-Encoding: identity Jul 13 21:06:37.407952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Connection: close Jul 13 21:06:37.407952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Length: 0 Jul 13 21:06:37.407952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Type: application/json Jul 13 21:06:37.407952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Host: 10.222.0.39 Jul 13 21:06:37.407952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Openstack-System-Scope: None Jul 13 21:06:37.407952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: User-Agent: python-urllib3/1.26.9 Jul 13 21:06:37.407952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Auth-Token: gAAAAABizzNuomAumwNPUgBSwGm_U0XkrTJliQLyRPgCRxNGHtIl0FIel-et7aYiOFm-QodSeqeZgoA8Xsm7DpnN4ZeB1CvTXE28FoLpzzQBE2LhyR77fu6ScnhuDmeni1eODvqoCMHeBKtaKFtF6fWJvC4QK9r0DAwC4p4i6i6AVoomER1DpcM Jul 13 21:06:37.407952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Id: None Jul 13 21:06:37.407952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Name: None Jul 13 21:06:37.407952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Identity-Status: Confirmed Jul 13 21:06:37.407952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Is-Admin-Project: True Jul 13 21:06:37.407952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Id: default Jul 13 21:06:37.407952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Name: Default Jul 13 21:06:37.407952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Id: 9eb5da85f8a74b08aef7b37cc209ca92 Jul 13 21:06:37.407952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Name: tempest-DeleteServersTestJSON-140957177 Jul 13 21:06:37.407952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Role: member,reader Jul 13 21:06:37.407952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Roles: member,reader Jul 13 21:06:37.409240 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9eb5da85f8a74b08aef7b37cc209ca92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9eb5da85f8a74b08aef7b37cc209ca92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9eb5da85f8a74b08aef7b37cc209ca92", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9eb5da85f8a74b08aef7b37cc209ca92"}]}] Jul 13 21:06:37.409240 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant: tempest-DeleteServersTestJSON-140957177 Jul 13 21:06:37.409240 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Id: 9eb5da85f8a74b08aef7b37cc209ca92 Jul 13 21:06:37.409240 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Name: tempest-DeleteServersTestJSON-140957177 Jul 13 21:06:37.409240 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User: tempest-DeleteServersTestJSON-140957177-project Jul 13 21:06:37.409240 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Id: default Jul 13 21:06:37.409240 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Name: Default Jul 13 21:06:37.409240 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Id: a28051d0f956461c8f3b39825e33af96 Jul 13 21:06:37.409240 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Name: tempest-DeleteServersTestJSON-140957177-project Jul 13 21:06:37.409240 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: method: > Jul 13 21:06:37.409240 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: exception: Instance 8ed35cd9-7632-4570-b17d-c08b19ed09d8 could not be found. Jul 13 21:06:37.409240 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: action_args: {'server_id': '8ed35cd9-7632-4570-b17d-c08b19ed09d8'} Jul 13 21:06:37.409880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:06:37.409880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:06:37.409880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:06:37.409880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:06:37.409880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:06:37.409880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:06:37.409880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:06:37.409880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:06:37.409880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:06:37.409880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:06:37.409880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ed35cd9-7632-4570-b17d-c08b19ed09d8 could not be found. Jul 13 21:06:37.409880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:06:37.409880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:06:37.409880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:06:37.409880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:06:37.409880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:06:37.409880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:06:37.409880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:06:37.409880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:06:37.409880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:06:37.411150 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:06:37.411150 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 13 21:06:37.411150 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 13 21:06:37.411150 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 13 21:06:37.411150 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 13 21:06:37.411150 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 13 21:06:37.411150 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 13 21:06:37.411150 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:06:37.411150 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:06:37.411150 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ed35cd9-7632-4570-b17d-c08b19ed09d8 could not be found. Jul 13 21:06:37.411150 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:06:37.411150 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:06:37.411150 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:06:37.411150 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:06:37.411150 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:06:37.411150 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:06:37.411150 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:06:37.411150 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:06:37.411150 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ed35cd9-7632-4570-b17d-c08b19ed09d8 could not be found. Jul 13 21:06:37.411150 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:06:37.412236 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-1783cc2e-40bf-4963-ae9e-1f417c8268fc tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Returning 404 to user: Instance 8ed35cd9-7632-4570-b17d-c08b19ed09d8 could not be found. {{(pid=118444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:06:37.412236 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-1783cc2e-40bf-4963-ae9e-1f417c8268fc tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039439 Jul 13 21:06:37.412236 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 151/311] 10.222.0.39 () {58 vars in 1301 bytes} [Wed Jul 13 21:06:37 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:06:40.708940 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-3530967a-3bd8-4ab7-96e6-b87784b21fe7 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:40.709582 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-3530967a-3bd8-4ab7-96e6-b87784b21fe7 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:40.716845 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3530967a-3bd8-4ab7-96e6-b87784b21fe7 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:40.717293 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3530967a-3bd8-4ab7-96e6-b87784b21fe7 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:40.718052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3530967a-3bd8-4ab7-96e6-b87784b21fe7 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:40.718482 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3530967a-3bd8-4ab7-96e6-b87784b21fe7 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:40.733825 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.wsgi [None req-3530967a-3bd8-4ab7-96e6-b87784b21fe7 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] HTTP exception thrown: Instance 8ed35cd9-7632-4570-b17d-c08b19ed09d8 could not be found. Jul 13 21:06:40.735437 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-3530967a-3bd8-4ab7-96e6-b87784b21fe7 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Request method failure captured: Jul 13 21:06:40.735437 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: request: DELETE /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 HTTP/1.1 Jul 13 21:06:40.735437 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept: application/json Jul 13 21:06:40.735437 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept-Encoding: identity Jul 13 21:06:40.735437 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Connection: close Jul 13 21:06:40.735437 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Length: 0 Jul 13 21:06:40.735437 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Type: application/json Jul 13 21:06:40.735437 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Host: 10.222.0.39 Jul 13 21:06:40.735437 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Openstack-System-Scope: None Jul 13 21:06:40.735437 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: User-Agent: python-urllib3/1.26.9 Jul 13 21:06:40.735437 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Auth-Token: gAAAAABizzNuomAumwNPUgBSwGm_U0XkrTJliQLyRPgCRxNGHtIl0FIel-et7aYiOFm-QodSeqeZgoA8Xsm7DpnN4ZeB1CvTXE28FoLpzzQBE2LhyR77fu6ScnhuDmeni1eODvqoCMHeBKtaKFtF6fWJvC4QK9r0DAwC4p4i6i6AVoomER1DpcM Jul 13 21:06:40.735437 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Id: None Jul 13 21:06:40.735437 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Name: None Jul 13 21:06:40.735437 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Identity-Status: Confirmed Jul 13 21:06:40.735437 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Is-Admin-Project: True Jul 13 21:06:40.735437 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Id: default Jul 13 21:06:40.735437 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Name: Default Jul 13 21:06:40.735437 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Id: 9eb5da85f8a74b08aef7b37cc209ca92 Jul 13 21:06:40.735437 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Name: tempest-DeleteServersTestJSON-140957177 Jul 13 21:06:40.735437 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Role: member,reader Jul 13 21:06:40.735437 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Roles: member,reader Jul 13 21:06:40.737508 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9eb5da85f8a74b08aef7b37cc209ca92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9eb5da85f8a74b08aef7b37cc209ca92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9eb5da85f8a74b08aef7b37cc209ca92", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9eb5da85f8a74b08aef7b37cc209ca92"}]}] Jul 13 21:06:40.737508 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant: tempest-DeleteServersTestJSON-140957177 Jul 13 21:06:40.737508 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Id: 9eb5da85f8a74b08aef7b37cc209ca92 Jul 13 21:06:40.737508 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Name: tempest-DeleteServersTestJSON-140957177 Jul 13 21:06:40.737508 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User: tempest-DeleteServersTestJSON-140957177-project Jul 13 21:06:40.737508 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Id: default Jul 13 21:06:40.737508 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Name: Default Jul 13 21:06:40.737508 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Id: a28051d0f956461c8f3b39825e33af96 Jul 13 21:06:40.737508 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Name: tempest-DeleteServersTestJSON-140957177-project Jul 13 21:06:40.737508 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: method: > Jul 13 21:06:40.737508 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: exception: Instance 8ed35cd9-7632-4570-b17d-c08b19ed09d8 could not be found. Jul 13 21:06:40.737508 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: action_args: {'id': '8ed35cd9-7632-4570-b17d-c08b19ed09d8'} Jul 13 21:06:40.738312 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:06:40.738312 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:06:40.738312 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:06:40.738312 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:06:40.738312 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:06:40.738312 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:06:40.738312 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:06:40.738312 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:06:40.738312 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:06:40.738312 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:06:40.738312 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ed35cd9-7632-4570-b17d-c08b19ed09d8 could not be found. Jul 13 21:06:40.738312 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:06:40.738312 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:06:40.738312 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:06:40.738312 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:06:40.738312 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:06:40.738312 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:06:40.738312 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:06:40.738312 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:06:40.738312 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:06:40.742654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:06:40.742654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 13 21:06:40.742654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 13 21:06:40.742654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 13 21:06:40.742654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 13 21:06:40.742654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:06:40.742654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:06:40.742654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:06:40.742654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:06:40.742654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ed35cd9-7632-4570-b17d-c08b19ed09d8 could not be found. Jul 13 21:06:40.742654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:06:40.742654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:06:40.742654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:06:40.742654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:06:40.742654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:06:40.742654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:06:40.742654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:06:40.742654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:06:40.742654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ed35cd9-7632-4570-b17d-c08b19ed09d8 could not be found. Jul 13 21:06:40.742654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:06:40.744314 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-3530967a-3bd8-4ab7-96e6-b87784b21fe7 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Returning 404 to user: Instance 8ed35cd9-7632-4570-b17d-c08b19ed09d8 could not be found. {{(pid=118445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:06:40.744314 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-3530967a-3bd8-4ab7-96e6-b87784b21fe7 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 404 len: 111 microversion: 2.1 time: 0.034351 Jul 13 21:06:40.744314 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 161/312] 10.222.0.39 () {58 vars in 1238 bytes} [Wed Jul 13 21:06:40 2022] DELETE /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:06:40.747144 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-60e194aa-d1eb-40a2-a3c9-52fdbe230069 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:40.747748 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-60e194aa-d1eb-40a2-a3c9-52fdbe230069 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] [instance: 8ed35cd9-7632-4570-b17d-c08b19ed09d8] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:40.753651 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-60e194aa-d1eb-40a2-a3c9-52fdbe230069 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:40.755298 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-60e194aa-d1eb-40a2-a3c9-52fdbe230069 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:40.755683 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-60e194aa-d1eb-40a2-a3c9-52fdbe230069 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:40.756203 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-60e194aa-d1eb-40a2-a3c9-52fdbe230069 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:40.770058 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.wsgi [None req-60e194aa-d1eb-40a2-a3c9-52fdbe230069 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] HTTP exception thrown: Instance 8ed35cd9-7632-4570-b17d-c08b19ed09d8 could not be found. Jul 13 21:06:40.772398 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-60e194aa-d1eb-40a2-a3c9-52fdbe230069 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Request method failure captured: Jul 13 21:06:40.772398 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: request: GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 HTTP/1.1 Jul 13 21:06:40.772398 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept: application/json Jul 13 21:06:40.772398 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept-Encoding: identity Jul 13 21:06:40.772398 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Connection: close Jul 13 21:06:40.772398 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Length: 0 Jul 13 21:06:40.772398 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Type: application/json Jul 13 21:06:40.772398 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Host: 10.222.0.39 Jul 13 21:06:40.772398 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Openstack-System-Scope: None Jul 13 21:06:40.772398 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: User-Agent: python-urllib3/1.26.9 Jul 13 21:06:40.772398 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Auth-Token: gAAAAABizzNuomAumwNPUgBSwGm_U0XkrTJliQLyRPgCRxNGHtIl0FIel-et7aYiOFm-QodSeqeZgoA8Xsm7DpnN4ZeB1CvTXE28FoLpzzQBE2LhyR77fu6ScnhuDmeni1eODvqoCMHeBKtaKFtF6fWJvC4QK9r0DAwC4p4i6i6AVoomER1DpcM Jul 13 21:06:40.772398 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Id: None Jul 13 21:06:40.772398 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Name: None Jul 13 21:06:40.772398 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Identity-Status: Confirmed Jul 13 21:06:40.772398 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Is-Admin-Project: True Jul 13 21:06:40.772398 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Id: default Jul 13 21:06:40.772398 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Name: Default Jul 13 21:06:40.772398 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Id: 9eb5da85f8a74b08aef7b37cc209ca92 Jul 13 21:06:40.772398 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Name: tempest-DeleteServersTestJSON-140957177 Jul 13 21:06:40.772398 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Role: member,reader Jul 13 21:06:40.772398 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Roles: member,reader Jul 13 21:06:40.773778 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9eb5da85f8a74b08aef7b37cc209ca92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9eb5da85f8a74b08aef7b37cc209ca92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9eb5da85f8a74b08aef7b37cc209ca92", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9eb5da85f8a74b08aef7b37cc209ca92"}]}] Jul 13 21:06:40.773778 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant: tempest-DeleteServersTestJSON-140957177 Jul 13 21:06:40.773778 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Id: 9eb5da85f8a74b08aef7b37cc209ca92 Jul 13 21:06:40.773778 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Name: tempest-DeleteServersTestJSON-140957177 Jul 13 21:06:40.773778 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User: tempest-DeleteServersTestJSON-140957177-project Jul 13 21:06:40.773778 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Id: default Jul 13 21:06:40.773778 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Name: Default Jul 13 21:06:40.773778 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Id: a28051d0f956461c8f3b39825e33af96 Jul 13 21:06:40.773778 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Name: tempest-DeleteServersTestJSON-140957177-project Jul 13 21:06:40.773778 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: method: > Jul 13 21:06:40.773778 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: exception: Instance 8ed35cd9-7632-4570-b17d-c08b19ed09d8 could not be found. Jul 13 21:06:40.773778 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: action_args: {'id': '8ed35cd9-7632-4570-b17d-c08b19ed09d8'} Jul 13 21:06:40.774637 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:06:40.774637 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:06:40.774637 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:06:40.774637 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:06:40.774637 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:06:40.774637 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:06:40.774637 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:06:40.774637 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:06:40.774637 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:06:40.774637 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:06:40.774637 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ed35cd9-7632-4570-b17d-c08b19ed09d8 could not be found. Jul 13 21:06:40.774637 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:06:40.774637 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:06:40.774637 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:06:40.774637 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:06:40.774637 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:06:40.774637 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:06:40.774637 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:06:40.774637 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:06:40.774637 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:06:40.776124 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:06:40.776124 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 21:06:40.776124 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 21:06:40.776124 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:06:40.776124 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:06:40.776124 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:06:40.776124 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:06:40.776124 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ed35cd9-7632-4570-b17d-c08b19ed09d8 could not be found. Jul 13 21:06:40.776124 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:06:40.776124 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:06:40.776124 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:06:40.776124 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:06:40.776124 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:06:40.776124 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:06:40.776124 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:06:40.776124 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:06:40.776124 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ed35cd9-7632-4570-b17d-c08b19ed09d8 could not be found. Jul 13 21:06:40.776124 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:06:40.777483 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-60e194aa-d1eb-40a2-a3c9-52fdbe230069 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] Returning 404 to user: Instance 8ed35cd9-7632-4570-b17d-c08b19ed09d8 could not be found. {{(pid=118444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:06:40.777483 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-60e194aa-d1eb-40a2-a3c9-52fdbe230069 tempest-DeleteServersTestJSON-140957177 tempest-DeleteServersTestJSON-140957177-project] 10.222.0.39 "GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8" status: 404 len: 111 microversion: 2.1 time: 0.030576 Jul 13 21:06:40.777483 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 152/313] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:40 2022] GET /compute/v2.1/servers/8ed35cd9-7632-4570-b17d-c08b19ed09d8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:06:54.232945 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_api:SELECT=11 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:06:54.234045 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=3 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:06:54.447921 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-5c25f49b-46e4-423a-81c5-f7c5ca7aa6a2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1121213608", "imageRef": "5a995c88-d784-4a51-a6b9-25aa9dfe607c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:06:54.550022 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.network.neutron [None req-5c25f49b-46e4-423a-81c5-f7c5ca7aa6a2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] validate_networks() for [('4b80b70e-3a69-4199-b81e-844abcd74aae', None, None, None, None, None)] {{(pid=118445) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 21:06:55.422052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-5c25f49b-46e4-423a-81c5-f7c5ca7aa6a2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Flavor limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 21:06:55.422775 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-5c25f49b-46e4-423a-81c5-f7c5ca7aa6a2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Image limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 21:06:55.423253 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-5c25f49b-46e4-423a-81c5-f7c5ca7aa6a2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Flavor pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 21:06:55.423727 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-5c25f49b-46e4-423a-81c5-f7c5ca7aa6a2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Image pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 21:06:55.424123 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-5c25f49b-46e4-423a-81c5-f7c5ca7aa6a2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 21:06:55.434430 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5c25f49b-46e4-423a-81c5-f7c5ca7aa6a2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:55.434908 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5c25f49b-46e4-423a-81c5-f7c5ca7aa6a2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:55.435925 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5c25f49b-46e4-423a-81c5-f7c5ca7aa6a2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:55.436663 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5c25f49b-46e4-423a-81c5-f7c5ca7aa6a2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:55.458038 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-5c25f49b-46e4-423a-81c5-f7c5ca7aa6a2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Getting quotas for project c1d4119a1d0b474fb568818f1aaa933b. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:06:55.464535 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-5c25f49b-46e4-423a-81c5-f7c5ca7aa6a2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Getting quotas for user dc40c07fceab4a83ba9324da868034aa and project c1d4119a1d0b474fb568818f1aaa933b. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:06:55.480478 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-5c25f49b-46e4-423a-81c5-f7c5ca7aa6a2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Going to run 1 instances... {{(pid=118445) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 21:06:55.484243 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-5c25f49b-46e4-423a-81c5-f7c5ca7aa6a2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995c88-d784-4a51-a6b9-25aa9dfe607c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118445) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 21:06:55.580938 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-5c25f49b-46e4-423a-81c5-f7c5ca7aa6a2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.350393 Jul 13 21:06:55.581928 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 162/314] 10.222.0.39 () {60 vars in 1146 bytes} [Wed Jul 13 21:06:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 1355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 21:06:55.593007 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-9ac866a5-51b7-41f6-a8b0-af1388256f53 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:55.593672 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-9ac866a5-51b7-41f6-a8b0-af1388256f53 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:55.596012 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_api:SELECT=3 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:06:55.597447 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=64,nova_cell1:INSERT=1 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:06:55.666402 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-9ac866a5-51b7-41f6-a8b0-af1388256f53 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:55.673934 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-9ac866a5-51b7-41f6-a8b0-af1388256f53 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1222 microversion: 2.1 time: 0.086286 Jul 13 21:06:55.674841 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 153/315] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:55 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:06:55.857007 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-8107fed8-48e3-4f4c-9943-fd9fde2ac55e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-754263339", "imageRef": "5a995c88-d784-4a51-a6b9-25aa9dfe607c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:06:55.945794 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.network.neutron [None req-8107fed8-48e3-4f4c-9943-fd9fde2ac55e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] validate_networks() for [('4b80b70e-3a69-4199-b81e-844abcd74aae', None, None, None, None, None)] {{(pid=118445) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 21:06:57.018977 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-8107fed8-48e3-4f4c-9943-fd9fde2ac55e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Flavor limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 21:06:57.020103 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-8107fed8-48e3-4f4c-9943-fd9fde2ac55e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Image limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 21:06:57.020752 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-8107fed8-48e3-4f4c-9943-fd9fde2ac55e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Flavor pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 21:06:57.021903 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-8107fed8-48e3-4f4c-9943-fd9fde2ac55e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Image pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 21:06:57.022526 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-8107fed8-48e3-4f4c-9943-fd9fde2ac55e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 21:06:57.041009 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8107fed8-48e3-4f4c-9943-fd9fde2ac55e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:57.041801 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8107fed8-48e3-4f4c-9943-fd9fde2ac55e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:57.049199 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8107fed8-48e3-4f4c-9943-fd9fde2ac55e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:57.049939 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8107fed8-48e3-4f4c-9943-fd9fde2ac55e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:57.078901 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-8107fed8-48e3-4f4c-9943-fd9fde2ac55e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Getting quotas for project c1d4119a1d0b474fb568818f1aaa933b. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:06:57.096769 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-8107fed8-48e3-4f4c-9943-fd9fde2ac55e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Getting quotas for user dc40c07fceab4a83ba9324da868034aa and project c1d4119a1d0b474fb568818f1aaa933b. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:06:57.117387 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8107fed8-48e3-4f4c-9943-fd9fde2ac55e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Going to run 1 instances... {{(pid=118445) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 21:06:57.122210 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8107fed8-48e3-4f4c-9943-fd9fde2ac55e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995c88-d784-4a51-a6b9-25aa9dfe607c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118445) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 21:06:57.177560 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-8107fed8-48e3-4f4c-9943-fd9fde2ac55e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.324088 Jul 13 21:06:57.179808 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 163/316] 10.222.0.39 () {60 vars in 1146 bytes} [Wed Jul 13 21:06:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 1328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 21:06:57.190593 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-1c7304ff-fd88-495f-b148-687b24fea3a9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:57.192159 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-1c7304ff-fd88-495f-b148-687b24fea3a9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:57.294651 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-1c7304ff-fd88-495f-b148-687b24fea3a9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:57.306162 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-1c7304ff-fd88-495f-b148-687b24fea3a9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1221 microversion: 2.1 time: 0.119492 Jul 13 21:06:57.318701 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 154/317] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:57 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1221 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:06:58.324508 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ae064dee-ae50-4883-b697-ff25afdd8b8d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:58.325145 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ae064dee-ae50-4883-b697-ff25afdd8b8d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:58.355872 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ae064dee-ae50-4883-b697-ff25afdd8b8d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:58.356662 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ae064dee-ae50-4883-b697-ff25afdd8b8d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:58.363666 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ae064dee-ae50-4883-b697-ff25afdd8b8d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:58.365672 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ae064dee-ae50-4883-b697-ff25afdd8b8d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:58.537781 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ae064dee-ae50-4883-b697-ff25afdd8b8d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:06:58.550188 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ae064dee-ae50-4883-b697-ff25afdd8b8d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1217 microversion: 2.1 time: 0.230146 Jul 13 21:06:58.551326 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 164/318] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:58 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1217 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:06:59.584827 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-69876645-b75e-4aaf-bf9b-89b7e1346440 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:06:59.585879 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-69876645-b75e-4aaf-bf9b-89b7e1346440 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:06:59.598307 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-69876645-b75e-4aaf-bf9b-89b7e1346440 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:59.602488 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-69876645-b75e-4aaf-bf9b-89b7e1346440 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:59.605077 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-69876645-b75e-4aaf-bf9b-89b7e1346440 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:06:59.621837 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-69876645-b75e-4aaf-bf9b-89b7e1346440 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:06:59.989724 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-69876645-b75e-4aaf-bf9b-89b7e1346440 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:00.003330 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-69876645-b75e-4aaf-bf9b-89b7e1346440 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1291 microversion: 2.1 time: 0.433991 Jul 13 21:07:00.004415 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 155/319] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:06:59 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1291 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:01.020624 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-0de28738-ac93-47b7-9663-02b1321efae6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:01.021380 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-0de28738-ac93-47b7-9663-02b1321efae6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:01.051390 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0de28738-ac93-47b7-9663-02b1321efae6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:01.052075 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0de28738-ac93-47b7-9663-02b1321efae6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:01.053636 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0de28738-ac93-47b7-9663-02b1321efae6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:01.055150 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0de28738-ac93-47b7-9663-02b1321efae6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:01.178744 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-0de28738-ac93-47b7-9663-02b1321efae6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:01.189935 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-0de28738-ac93-47b7-9663-02b1321efae6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1279 microversion: 2.1 time: 0.174161 Jul 13 21:07:01.193234 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 165/320] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:01 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1279 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:02.219872 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ef87dad3-6283-4862-ae12-bcce6a3d6e6c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:02.221156 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-ef87dad3-6283-4862-ae12-bcce6a3d6e6c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:02.233751 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ef87dad3-6283-4862-ae12-bcce6a3d6e6c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:02.234202 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ef87dad3-6283-4862-ae12-bcce6a3d6e6c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:02.241283 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ef87dad3-6283-4862-ae12-bcce6a3d6e6c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:02.242780 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ef87dad3-6283-4862-ae12-bcce6a3d6e6c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:02.425069 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ef87dad3-6283-4862-ae12-bcce6a3d6e6c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:02.434887 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ef87dad3-6283-4862-ae12-bcce6a3d6e6c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1279 microversion: 2.1 time: 0.228293 Jul 13 21:07:02.437980 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 156/321] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:02 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1279 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:03.508780 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ab94a2f5-81f7-4318-b38c-0e98766d4285 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:03.509634 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ab94a2f5-81f7-4318-b38c-0e98766d4285 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:03.529860 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ab94a2f5-81f7-4318-b38c-0e98766d4285 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:03.535656 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ab94a2f5-81f7-4318-b38c-0e98766d4285 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:03.538183 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ab94a2f5-81f7-4318-b38c-0e98766d4285 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:03.540566 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ab94a2f5-81f7-4318-b38c-0e98766d4285 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:03.875517 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ab94a2f5-81f7-4318-b38c-0e98766d4285 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:03.883961 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ab94a2f5-81f7-4318-b38c-0e98766d4285 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1321 microversion: 2.1 time: 0.427350 Jul 13 21:07:03.884852 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 166/322] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:03 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1321 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:03.942208 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-8fb21410-404f-4e7f-b5f3-1c0f4e3258fe req-b0f47276-7af5-44aa-bab0-6c8f8e84b45b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0f6b2e3-dfe2-417f-a343-d2d9b990df70", "tag": "9f1a0181-71ef-4629-8374-dc5acba51596"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:07:03.957848 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-8fb21410-404f-4e7f-b5f3-1c0f4e3258fe req-b0f47276-7af5-44aa-bab0-6c8f8e84b45b service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:03.958256 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-8fb21410-404f-4e7f-b5f3-1c0f4e3258fe req-b0f47276-7af5-44aa-bab0-6c8f8e84b45b service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:03.977240 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-8fb21410-404f-4e7f-b5f3-1c0f4e3258fe req-b0f47276-7af5-44aa-bab0-6c8f8e84b45b service nova] Creating event network-changed:9f1a0181-71ef-4629-8374-dc5acba51596 for instance b0f6b2e3-dfe2-417f-a343-d2d9b990df70 on hv-cinder-79987 Jul 13 21:07:03.983859 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-8fb21410-404f-4e7f-b5f3-1c0f4e3258fe req-b0f47276-7af5-44aa-bab0-6c8f8e84b45b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045223 Jul 13 21:07:03.984730 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 157/323] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:07:04.901123 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-4bd02e3c-e161-4920-8ef6-ff26afb9981c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:04.901745 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-4bd02e3c-e161-4920-8ef6-ff26afb9981c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:04.910675 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4bd02e3c-e161-4920-8ef6-ff26afb9981c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:04.915396 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4bd02e3c-e161-4920-8ef6-ff26afb9981c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:04.923999 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4bd02e3c-e161-4920-8ef6-ff26afb9981c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:04.924225 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4bd02e3c-e161-4920-8ef6-ff26afb9981c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:05.185621 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-4bd02e3c-e161-4920-8ef6-ff26afb9981c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:05.194948 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-4bd02e3c-e161-4920-8ef6-ff26afb9981c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1321 microversion: 2.1 time: 0.297515 Jul 13 21:07:05.195777 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 167/324] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:04 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1321 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:06.010182 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-6b39a5a2-c7d8-4ca2-b559-532c768e32c3 req-ef1f798d-5ffb-40dc-ba8e-9c6027a7224b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77562fb4-e9e7-411b-bf21-3a8d3f8f0cea", "tag": "14306988-fa76-49d8-91c1-ef2b82d04f8b"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:07:06.024509 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-6b39a5a2-c7d8-4ca2-b559-532c768e32c3 req-ef1f798d-5ffb-40dc-ba8e-9c6027a7224b service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:06.026324 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-6b39a5a2-c7d8-4ca2-b559-532c768e32c3 req-ef1f798d-5ffb-40dc-ba8e-9c6027a7224b service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:06.059800 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-6b39a5a2-c7d8-4ca2-b559-532c768e32c3 req-ef1f798d-5ffb-40dc-ba8e-9c6027a7224b service nova] Creating event network-changed:14306988-fa76-49d8-91c1-ef2b82d04f8b for instance 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea on hv-cinder-79987 Jul 13 21:07:06.064886 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-6b39a5a2-c7d8-4ca2-b559-532c768e32c3 req-ef1f798d-5ffb-40dc-ba8e-9c6027a7224b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059630 Jul 13 21:07:06.065796 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 158/325] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:07:06.211890 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-28098046-ce27-47db-8beb-c2f9cb9336aa tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:06.212472 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-28098046-ce27-47db-8beb-c2f9cb9336aa tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:06.221400 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-28098046-ce27-47db-8beb-c2f9cb9336aa tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:06.222169 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-28098046-ce27-47db-8beb-c2f9cb9336aa tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:06.223206 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-28098046-ce27-47db-8beb-c2f9cb9336aa tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:06.224075 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-28098046-ce27-47db-8beb-c2f9cb9336aa tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:06.383398 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-28098046-ce27-47db-8beb-c2f9cb9336aa tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:06.399205 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-28098046-ce27-47db-8beb-c2f9cb9336aa tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1321 microversion: 2.1 time: 0.190886 Jul 13 21:07:06.401935 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 168/326] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:06 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:07.419138 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b2cbc3ed-74dd-4538-b392-5ddf3c7e9d78 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:07.420465 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b2cbc3ed-74dd-4538-b392-5ddf3c7e9d78 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:07.426787 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell0:SELECT=4 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:07:07.429374 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b2cbc3ed-74dd-4538-b392-5ddf3c7e9d78 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:07.430100 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b2cbc3ed-74dd-4538-b392-5ddf3c7e9d78 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:07.431106 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b2cbc3ed-74dd-4538-b392-5ddf3c7e9d78 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:07.431739 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b2cbc3ed-74dd-4538-b392-5ddf3c7e9d78 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:07.777500 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b2cbc3ed-74dd-4538-b392-5ddf3c7e9d78 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:07.786334 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b2cbc3ed-74dd-4538-b392-5ddf3c7e9d78 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1321 microversion: 2.1 time: 0.371346 Jul 13 21:07:07.796236 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 159/327] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:07 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1321 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:08.364408 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-b8147f19-c760-41bc-ad3a-0adf90385b6b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-333001714", "imageRef": "5a995c88-d784-4a51-a6b9-25aa9dfe607c", "flavorRef": "452", "networks": [{"uuid": "4ccee2ee-7321-412b-b2ec-e81fd12a0d90"}]}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:07:08.377679 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=4 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:07:08.378648 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=12 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:07:08.442684 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.network.neutron [None req-b8147f19-c760-41bc-ad3a-0adf90385b6b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] validate_networks() for [('4ccee2ee-7321-412b-b2ec-e81fd12a0d90', None, None, None, None, None)] {{(pid=118445) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 21:07:08.802873 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-9bddf203-78de-41ab-8502-8acf59d854c2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:08.803485 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-9bddf203-78de-41ab-8502-8acf59d854c2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:08.809938 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9bddf203-78de-41ab-8502-8acf59d854c2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:08.810840 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9bddf203-78de-41ab-8502-8acf59d854c2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:08.811840 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9bddf203-78de-41ab-8502-8acf59d854c2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:08.813250 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9bddf203-78de-41ab-8502-8acf59d854c2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:09.122368 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-9bddf203-78de-41ab-8502-8acf59d854c2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:09.135982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-9bddf203-78de-41ab-8502-8acf59d854c2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1321 microversion: 2.1 time: 0.336619 Jul 13 21:07:09.137898 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 160/328] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:08 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1321 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:09.243144 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-b8147f19-c760-41bc-ad3a-0adf90385b6b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Flavor limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 21:07:09.243809 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-b8147f19-c760-41bc-ad3a-0adf90385b6b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Image limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 21:07:09.244965 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-b8147f19-c760-41bc-ad3a-0adf90385b6b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Flavor pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 21:07:09.245659 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-b8147f19-c760-41bc-ad3a-0adf90385b6b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Image pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 21:07:09.246324 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-b8147f19-c760-41bc-ad3a-0adf90385b6b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 21:07:09.260085 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b8147f19-c760-41bc-ad3a-0adf90385b6b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:09.261036 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b8147f19-c760-41bc-ad3a-0adf90385b6b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:09.262405 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b8147f19-c760-41bc-ad3a-0adf90385b6b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:09.263318 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b8147f19-c760-41bc-ad3a-0adf90385b6b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:09.300766 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-b8147f19-c760-41bc-ad3a-0adf90385b6b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Getting quotas for project 2332a661874a4a2faebb32a154be663c. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:07:09.306505 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-b8147f19-c760-41bc-ad3a-0adf90385b6b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Getting quotas for user c9074c8e166b4cd2a3cff41f0ccca273 and project 2332a661874a4a2faebb32a154be663c. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:07:09.320548 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-b8147f19-c760-41bc-ad3a-0adf90385b6b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Going to run 1 instances... {{(pid=118445) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 21:07:09.323043 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-b8147f19-c760-41bc-ad3a-0adf90385b6b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995c88-d784-4a51-a6b9-25aa9dfe607c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118445) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 21:07:09.382110 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-b8147f19-c760-41bc-ad3a-0adf90385b6b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.021901 Jul 13 21:07:09.394973 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ff505b2d-d719-424f-88c8-73b2a1327f3a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:09.396622 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-ff505b2d-d719-424f-88c8-73b2a1327f3a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:09.402890 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 169/329] 10.222.0.39 () {60 vars in 1146 bytes} [Wed Jul 13 21:07:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 21:07:09.478595 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ff505b2d-d719-424f-88c8-73b2a1327f3a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:09.487432 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ff505b2d-d719-424f-88c8-73b2a1327f3a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1218 microversion: 2.1 time: 0.097620 Jul 13 21:07:09.488285 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 161/330] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:09 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:10.158997 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-1e64fa93-d849-43c8-ad1e-de8da6c64135 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:10.159725 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-1e64fa93-d849-43c8-ad1e-de8da6c64135 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:10.167779 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1e64fa93-d849-43c8-ad1e-de8da6c64135 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:10.169758 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1e64fa93-d849-43c8-ad1e-de8da6c64135 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:10.170874 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1e64fa93-d849-43c8-ad1e-de8da6c64135 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:10.171847 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1e64fa93-d849-43c8-ad1e-de8da6c64135 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:10.396922 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-1e64fa93-d849-43c8-ad1e-de8da6c64135 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:10.412399 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-1e64fa93-d849-43c8-ad1e-de8da6c64135 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1321 microversion: 2.1 time: 0.260815 Jul 13 21:07:10.414373 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 170/331] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:10 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:10.510499 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-56893b83-c9af-46ce-8bfb-e74a4e857cf8 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:10.511954 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-56893b83-c9af-46ce-8bfb-e74a4e857cf8 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:10.557322 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-56893b83-c9af-46ce-8bfb-e74a4e857cf8 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:10.562507 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-56893b83-c9af-46ce-8bfb-e74a4e857cf8 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:10.570959 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-56893b83-c9af-46ce-8bfb-e74a4e857cf8 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:10.572848 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-56893b83-c9af-46ce-8bfb-e74a4e857cf8 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:10.748374 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-56893b83-c9af-46ce-8bfb-e74a4e857cf8 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:10.757724 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-56893b83-c9af-46ce-8bfb-e74a4e857cf8 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1222 microversion: 2.1 time: 0.254603 Jul 13 21:07:10.775876 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 162/332] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:10 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1222 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:11.431494 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-321137ff-12fc-4491-8170-0eca2aaae630 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:11.432199 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-321137ff-12fc-4491-8170-0eca2aaae630 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:11.439745 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-321137ff-12fc-4491-8170-0eca2aaae630 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:11.440534 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-321137ff-12fc-4491-8170-0eca2aaae630 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:11.441847 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-321137ff-12fc-4491-8170-0eca2aaae630 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:11.442714 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-321137ff-12fc-4491-8170-0eca2aaae630 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:11.625731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-321137ff-12fc-4491-8170-0eca2aaae630 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:11.634193 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-321137ff-12fc-4491-8170-0eca2aaae630 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1321 microversion: 2.1 time: 0.206579 Jul 13 21:07:11.635104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 171/333] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:11 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:11.781605 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-a7200337-7d09-4a12-818a-debed1ee103a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:11.783607 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-a7200337-7d09-4a12-818a-debed1ee103a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:11.789914 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a7200337-7d09-4a12-818a-debed1ee103a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:11.790360 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a7200337-7d09-4a12-818a-debed1ee103a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:11.791163 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a7200337-7d09-4a12-818a-debed1ee103a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:11.791602 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a7200337-7d09-4a12-818a-debed1ee103a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:11.875169 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-a7200337-7d09-4a12-818a-debed1ee103a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:11.884588 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-a7200337-7d09-4a12-818a-debed1ee103a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1222 microversion: 2.1 time: 0.106538 Jul 13 21:07:11.885383 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 163/334] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:11 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:12.653308 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-a30c92c8-ff83-41df-82e2-8c5a80189370 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:12.653919 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-a30c92c8-ff83-41df-82e2-8c5a80189370 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:12.660570 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a30c92c8-ff83-41df-82e2-8c5a80189370 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:12.661360 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a30c92c8-ff83-41df-82e2-8c5a80189370 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:12.662371 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a30c92c8-ff83-41df-82e2-8c5a80189370 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:12.662902 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a30c92c8-ff83-41df-82e2-8c5a80189370 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:12.810800 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-a30c92c8-ff83-41df-82e2-8c5a80189370 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:12.818590 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-a30c92c8-ff83-41df-82e2-8c5a80189370 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1321 microversion: 2.1 time: 0.171372 Jul 13 21:07:12.819185 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 172/335] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:12 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:12.901708 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-7bf72824-1619-4c82-b2d0-448235886239 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:12.902459 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-7bf72824-1619-4c82-b2d0-448235886239 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:12.911374 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7bf72824-1619-4c82-b2d0-448235886239 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:12.912057 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7bf72824-1619-4c82-b2d0-448235886239 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:12.913390 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7bf72824-1619-4c82-b2d0-448235886239 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:12.913982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7bf72824-1619-4c82-b2d0-448235886239 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:12.987013 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-7bf72824-1619-4c82-b2d0-448235886239 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:12.995042 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-7bf72824-1619-4c82-b2d0-448235886239 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1222 microversion: 2.1 time: 0.097095 Jul 13 21:07:12.995897 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 164/336] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:12 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:13.836970 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-0ac8ecd3-805e-4425-849f-c7d0193a60ba tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:13.837625 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-0ac8ecd3-805e-4425-849f-c7d0193a60ba tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:13.844461 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0ac8ecd3-805e-4425-849f-c7d0193a60ba tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:13.844931 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0ac8ecd3-805e-4425-849f-c7d0193a60ba tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:13.845699 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0ac8ecd3-805e-4425-849f-c7d0193a60ba tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:13.846124 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0ac8ecd3-805e-4425-849f-c7d0193a60ba tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:14.012144 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-619bacbc-0425-429a-b3ec-76d0f5cd5020 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:14.012741 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-619bacbc-0425-429a-b3ec-76d0f5cd5020 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:14.022802 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-619bacbc-0425-429a-b3ec-76d0f5cd5020 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:14.023659 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-619bacbc-0425-429a-b3ec-76d0f5cd5020 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:14.024689 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-619bacbc-0425-429a-b3ec-76d0f5cd5020 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:14.027512 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-619bacbc-0425-429a-b3ec-76d0f5cd5020 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:14.291974 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-0ac8ecd3-805e-4425-849f-c7d0193a60ba tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:14.302428 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-0ac8ecd3-805e-4425-849f-c7d0193a60ba tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1321 microversion: 2.1 time: 0.469472 Jul 13 21:07:14.314799 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 173/337] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:13 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1321 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:14.535366 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-619bacbc-0425-429a-b3ec-76d0f5cd5020 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:14.540024 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-b3ce0b45-b26e-4f0e-8e52-76660b04c4a9 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Action: 'create', calling method: .version_select at 0x7f96e8969670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-239570111", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgZ6f/puqLonG9IngX97hJUxYBMbo1sS348+AvHe0w+X89jlL/X94Wa15mb/V6qruc3gIOvkr4Ki8pOPLHKuP3hPa5aUCSAXbBIUktJAK/MPsGsLUamN+iBkvhA7AfZzg=="}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:07:14.543475 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-619bacbc-0425-429a-b3ec-76d0f5cd5020 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1278 microversion: 2.1 time: 0.535102 Jul 13 21:07:14.544274 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 165/338] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:14 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1278 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:07:14.556598 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-b3ce0b45-b26e-4f0e-8e52-76660b04c4a9 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Getting quotas for project c09f02b3463a47e68081b8b47cc86985. Resources: {'key_pairs'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:07:14.560780 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-b3ce0b45-b26e-4f0e-8e52-76660b04c4a9 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Getting quotas for user 0c321d34fcce4054849926e924b3c0a8 and project c09f02b3463a47e68081b8b47cc86985. Resources: {'key_pairs'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:07:14.583867 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-b3ce0b45-b26e-4f0e-8e52-76660b04c4a9 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.047963 Jul 13 21:07:14.584386 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 174/339] 10.222.0.39 () {60 vars in 1158 bytes} [Wed Jul 13 21:07:14 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:07:14.687213 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-c47eba14-0ac4-4ff2-9ac2-80e73fbaf11f tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1902167132", "imageRef": "c9ed9399-6224-479d-8593-4568e13cb59c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-239570111", "networks": [{"uuid": "6109997c-2631-40cc-9244-6dee3195fd15"}]}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:07:14.743597 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.network.neutron [None req-c47eba14-0ac4-4ff2-9ac2-80e73fbaf11f tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] validate_networks() for [('6109997c-2631-40cc-9244-6dee3195fd15', None, None, None, None, None)] {{(pid=118444) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 21:07:15.332392 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-2ff594ec-dfee-4eea-ab52-cdd6e5ad8168 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:15.333339 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-2ff594ec-dfee-4eea-ab52-cdd6e5ad8168 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:15.340362 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2ff594ec-dfee-4eea-ab52-cdd6e5ad8168 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:15.341149 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2ff594ec-dfee-4eea-ab52-cdd6e5ad8168 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:15.342100 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2ff594ec-dfee-4eea-ab52-cdd6e5ad8168 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:15.344225 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2ff594ec-dfee-4eea-ab52-cdd6e5ad8168 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:15.361398 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.virt.hardware [None req-c47eba14-0ac4-4ff2-9ac2-80e73fbaf11f tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Flavor limits 0:0:0 {{(pid=118444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 21:07:15.367867 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.virt.hardware [None req-c47eba14-0ac4-4ff2-9ac2-80e73fbaf11f tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Image limits 0:0:0 {{(pid=118444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 21:07:15.370199 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.virt.hardware [None req-c47eba14-0ac4-4ff2-9ac2-80e73fbaf11f tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Flavor pref 0:0:0 {{(pid=118444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 21:07:15.372726 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.virt.hardware [None req-c47eba14-0ac4-4ff2-9ac2-80e73fbaf11f tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Image pref 0:0:0 {{(pid=118444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 21:07:15.373498 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.virt.hardware [None req-c47eba14-0ac4-4ff2-9ac2-80e73fbaf11f tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 21:07:15.399472 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c47eba14-0ac4-4ff2-9ac2-80e73fbaf11f tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:15.400302 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c47eba14-0ac4-4ff2-9ac2-80e73fbaf11f tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:15.403917 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c47eba14-0ac4-4ff2-9ac2-80e73fbaf11f tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:15.404694 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c47eba14-0ac4-4ff2-9ac2-80e73fbaf11f tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:15.426604 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.quota [None req-c47eba14-0ac4-4ff2-9ac2-80e73fbaf11f tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Getting quotas for project c09f02b3463a47e68081b8b47cc86985. Resources: {'cores', 'instances', 'ram'} {{(pid=118444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:07:15.432217 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.quota [None req-c47eba14-0ac4-4ff2-9ac2-80e73fbaf11f tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Getting quotas for user 0c321d34fcce4054849926e924b3c0a8 and project c09f02b3463a47e68081b8b47cc86985. Resources: {'cores', 'instances', 'ram'} {{(pid=118444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:07:15.464459 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-c47eba14-0ac4-4ff2-9ac2-80e73fbaf11f tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Going to run 1 instances... {{(pid=118444) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 21:07:15.468154 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-c47eba14-0ac4-4ff2-9ac2-80e73fbaf11f tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9ed9399-6224-479d-8593-4568e13cb59c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 21:07:15.523694 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-c47eba14-0ac4-4ff2-9ac2-80e73fbaf11f tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.840082 Jul 13 21:07:15.526200 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 166/340] 10.222.0.39 () {60 vars in 1146 bytes} [Wed Jul 13 21:07:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 13 21:07:15.538234 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-744ac9f0-9f87-4553-8361-1b5f7b3ec2dd tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:15.539922 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-744ac9f0-9f87-4553-8361-1b5f7b3ec2dd tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:15.549944 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-2ff594ec-dfee-4eea-ab52-cdd6e5ad8168 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:15.564979 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-2ff594ec-dfee-4eea-ab52-cdd6e5ad8168 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1321 microversion: 2.1 time: 0.233680 Jul 13 21:07:15.566801 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 175/341] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:15 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:15.581665 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-f21dafb6-be23-4b41-bebb-e12727736c81 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:15.582282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-f21dafb6-be23-4b41-bebb-e12727736c81 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:15.589191 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f21dafb6-be23-4b41-bebb-e12727736c81 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:15.591146 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f21dafb6-be23-4b41-bebb-e12727736c81 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:15.594074 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f21dafb6-be23-4b41-bebb-e12727736c81 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:15.595435 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f21dafb6-be23-4b41-bebb-e12727736c81 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:15.669536 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-744ac9f0-9f87-4553-8361-1b5f7b3ec2dd tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:15.677888 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-744ac9f0-9f87-4553-8361-1b5f7b3ec2dd tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1258 microversion: 2.1 time: 0.144775 Jul 13 21:07:15.686829 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 167/342] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:15 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:07:15.864901 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-f21dafb6-be23-4b41-bebb-e12727736c81 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:15.880833 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-f21dafb6-be23-4b41-bebb-e12727736c81 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1318 microversion: 2.1 time: 0.311541 Jul 13 21:07:15.895858 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 176/343] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:15 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:15.896006 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-4c4d0d34-4acd-43cd-9f07-09d7282f7cee req-839d50af-4a8c-4fc8-9411-5b4f91b87d54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0f6b2e3-dfe2-417f-a343-d2d9b990df70", "name": "network-vif-plugged", "status": "completed", "tag": "9f1a0181-71ef-4629-8374-dc5acba51596"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:07:15.921062 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-4c4d0d34-4acd-43cd-9f07-09d7282f7cee req-839d50af-4a8c-4fc8-9411-5b4f91b87d54 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:15.925479 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-4c4d0d34-4acd-43cd-9f07-09d7282f7cee req-839d50af-4a8c-4fc8-9411-5b4f91b87d54 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:15.959775 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-4c4d0d34-4acd-43cd-9f07-09d7282f7cee req-839d50af-4a8c-4fc8-9411-5b4f91b87d54 service nova] Creating event network-vif-plugged:9f1a0181-71ef-4629-8374-dc5acba51596 for instance b0f6b2e3-dfe2-417f-a343-d2d9b990df70 on hv-cinder-79987 Jul 13 21:07:15.968653 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-4c4d0d34-4acd-43cd-9f07-09d7282f7cee req-839d50af-4a8c-4fc8-9411-5b4f91b87d54 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077620 Jul 13 21:07:15.969260 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 168/344] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:07:16.493256 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-c6e14d90-66b6-49c1-a160-70010dafe9c4 req-499c0492-11c5-4ded-8c8d-60444c5f5bee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d43b7a85-7ba7-404c-b1f7-56e9bebc4532", "tag": "317898b2-465a-4c11-b821-ef1b8829d78f"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:07:16.502416 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-c6e14d90-66b6-49c1-a160-70010dafe9c4 req-499c0492-11c5-4ded-8c8d-60444c5f5bee service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:16.502958 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-c6e14d90-66b6-49c1-a160-70010dafe9c4 req-499c0492-11c5-4ded-8c8d-60444c5f5bee service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:16.513660 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-c6e14d90-66b6-49c1-a160-70010dafe9c4 req-499c0492-11c5-4ded-8c8d-60444c5f5bee service nova] Creating event network-changed:317898b2-465a-4c11-b821-ef1b8829d78f for instance d43b7a85-7ba7-404c-b1f7-56e9bebc4532 on hv-cinder-79987 Jul 13 21:07:16.519177 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-c6e14d90-66b6-49c1-a160-70010dafe9c4 req-499c0492-11c5-4ded-8c8d-60444c5f5bee service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029780 Jul 13 21:07:16.519834 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 177/345] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:07:16.583126 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-d57f987e-1e64-4f25-b67f-ab788fdab683 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:16.583823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-d57f987e-1e64-4f25-b67f-ab788fdab683 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:16.589956 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d57f987e-1e64-4f25-b67f-ab788fdab683 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:16.590405 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d57f987e-1e64-4f25-b67f-ab788fdab683 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:16.591193 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d57f987e-1e64-4f25-b67f-ab788fdab683 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:16.591630 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d57f987e-1e64-4f25-b67f-ab788fdab683 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:16.704448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-dc3121f6-e735-4e62-850b-495abf033450 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:16.705264 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-dc3121f6-e735-4e62-850b-495abf033450 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:16.711359 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-dc3121f6-e735-4e62-850b-495abf033450 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:16.711798 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-dc3121f6-e735-4e62-850b-495abf033450 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:16.712543 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-dc3121f6-e735-4e62-850b-495abf033450 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:16.712967 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-dc3121f6-e735-4e62-850b-495abf033450 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:16.717998 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-d57f987e-1e64-4f25-b67f-ab788fdab683 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:16.725570 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-d57f987e-1e64-4f25-b67f-ab788fdab683 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1321 microversion: 2.1 time: 0.147302 Jul 13 21:07:16.726126 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 169/346] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:16 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:16.773258 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-dc3121f6-e735-4e62-850b-495abf033450 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:16.780553 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-dc3121f6-e735-4e62-850b-495abf033450 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1310 microversion: 2.1 time: 0.080799 Jul 13 21:07:16.781094 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 178/347] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:16 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1310 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:07:16.897994 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b3b3314c-95a7-4644-8a07-cf8b55ddfe2a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:16.898590 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b3b3314c-95a7-4644-8a07-cf8b55ddfe2a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:16.905407 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b3b3314c-95a7-4644-8a07-cf8b55ddfe2a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:16.905858 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b3b3314c-95a7-4644-8a07-cf8b55ddfe2a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:16.906714 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b3b3314c-95a7-4644-8a07-cf8b55ddfe2a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:16.907084 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b3b3314c-95a7-4644-8a07-cf8b55ddfe2a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:17.055607 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b3b3314c-95a7-4644-8a07-cf8b55ddfe2a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:17.062883 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b3b3314c-95a7-4644-8a07-cf8b55ddfe2a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1318 microversion: 2.1 time: 0.168916 Jul 13 21:07:17.064077 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 170/348] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:16 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:17.742703 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c22a9ffc-84fc-4d57-8fe2-dfe73d5bfa47 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:17.743346 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-c22a9ffc-84fc-4d57-8fe2-dfe73d5bfa47 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:17.750532 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c22a9ffc-84fc-4d57-8fe2-dfe73d5bfa47 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:17.751418 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c22a9ffc-84fc-4d57-8fe2-dfe73d5bfa47 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:17.752375 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c22a9ffc-84fc-4d57-8fe2-dfe73d5bfa47 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:17.752818 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c22a9ffc-84fc-4d57-8fe2-dfe73d5bfa47 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:17.797417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-bf7bef07-bd70-4e4f-962a-808b661c9d60 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:17.798384 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-bf7bef07-bd70-4e4f-962a-808b661c9d60 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:17.805073 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bf7bef07-bd70-4e4f-962a-808b661c9d60 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:17.805691 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bf7bef07-bd70-4e4f-962a-808b661c9d60 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:17.807005 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bf7bef07-bd70-4e4f-962a-808b661c9d60 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:17.807505 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bf7bef07-bd70-4e4f-962a-808b661c9d60 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:17.897237 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c22a9ffc-84fc-4d57-8fe2-dfe73d5bfa47 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:17.905539 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-c22a9ffc-84fc-4d57-8fe2-dfe73d5bfa47 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1321 microversion: 2.1 time: 0.166808 Jul 13 21:07:17.906106 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 179/349] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:17 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:17.957172 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-bf7bef07-bd70-4e4f-962a-808b661c9d60 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:17.965020 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-bf7bef07-bd70-4e4f-962a-808b661c9d60 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1310 microversion: 2.1 time: 0.171575 Jul 13 21:07:17.965588 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 171/350] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:17 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1310 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:07:17.984282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-6b921b53-a9f9-4964-b939-d60d69875360 req-c8548263-e6d1-4880-818a-7e27681b0c41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77562fb4-e9e7-411b-bf21-3a8d3f8f0cea", "name": "network-vif-plugged", "status": "completed", "tag": "14306988-fa76-49d8-91c1-ef2b82d04f8b"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:07:17.992352 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-6b921b53-a9f9-4964-b939-d60d69875360 req-c8548263-e6d1-4880-818a-7e27681b0c41 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:17.992795 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-6b921b53-a9f9-4964-b939-d60d69875360 req-c8548263-e6d1-4880-818a-7e27681b0c41 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:18.003757 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-6b921b53-a9f9-4964-b939-d60d69875360 req-c8548263-e6d1-4880-818a-7e27681b0c41 service nova] Creating event network-vif-plugged:14306988-fa76-49d8-91c1-ef2b82d04f8b for instance 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea on hv-cinder-79987 Jul 13 21:07:18.008400 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-6b921b53-a9f9-4964-b939-d60d69875360 req-c8548263-e6d1-4880-818a-7e27681b0c41 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027729 Jul 13 21:07:18.008972 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 180/351] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:07:18.079386 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-d0f9cf44-8029-4fa9-9dc1-a46b4a301ed4 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:18.079922 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-d0f9cf44-8029-4fa9-9dc1-a46b4a301ed4 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:18.087259 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d0f9cf44-8029-4fa9-9dc1-a46b4a301ed4 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:18.087831 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d0f9cf44-8029-4fa9-9dc1-a46b4a301ed4 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:18.088703 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d0f9cf44-8029-4fa9-9dc1-a46b4a301ed4 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:18.089213 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d0f9cf44-8029-4fa9-9dc1-a46b4a301ed4 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:18.214322 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-d0f9cf44-8029-4fa9-9dc1-a46b4a301ed4 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:18.221710 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-d0f9cf44-8029-4fa9-9dc1-a46b4a301ed4 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1318 microversion: 2.1 time: 0.146738 Jul 13 21:07:18.222262 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 172/352] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:18 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:18.924336 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c9dba37d-6b4b-4b35-9bed-32cbfa05212d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:18.925042 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-c9dba37d-6b4b-4b35-9bed-32cbfa05212d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:18.936759 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c9dba37d-6b4b-4b35-9bed-32cbfa05212d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:18.937303 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c9dba37d-6b4b-4b35-9bed-32cbfa05212d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:18.938381 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c9dba37d-6b4b-4b35-9bed-32cbfa05212d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:18.939271 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c9dba37d-6b4b-4b35-9bed-32cbfa05212d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:18.981257 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b0011046-8cd3-4cae-8c37-30472b14fbf8 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:18.981867 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b0011046-8cd3-4cae-8c37-30472b14fbf8 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:18.996204 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b0011046-8cd3-4cae-8c37-30472b14fbf8 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:18.996878 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b0011046-8cd3-4cae-8c37-30472b14fbf8 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:18.997715 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b0011046-8cd3-4cae-8c37-30472b14fbf8 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:18.998196 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b0011046-8cd3-4cae-8c37-30472b14fbf8 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:19.118346 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b0011046-8cd3-4cae-8c37-30472b14fbf8 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:19.128190 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b0011046-8cd3-4cae-8c37-30472b14fbf8 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1316 microversion: 2.1 time: 0.150419 Jul 13 21:07:19.130029 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 173/353] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:18 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:19.137855 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c9dba37d-6b4b-4b35-9bed-32cbfa05212d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:19.146787 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-c9dba37d-6b4b-4b35-9bed-32cbfa05212d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1321 microversion: 2.1 time: 0.227228 Jul 13 21:07:19.158214 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 181/354] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:18 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:19.237413 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-301f110b-113a-46fa-b85e-7978c312cac2 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:19.237993 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-301f110b-113a-46fa-b85e-7978c312cac2 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:19.243980 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-301f110b-113a-46fa-b85e-7978c312cac2 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:19.244415 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-301f110b-113a-46fa-b85e-7978c312cac2 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:19.245415 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-301f110b-113a-46fa-b85e-7978c312cac2 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:19.245847 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-301f110b-113a-46fa-b85e-7978c312cac2 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:19.482193 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-301f110b-113a-46fa-b85e-7978c312cac2 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:19.494239 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-301f110b-113a-46fa-b85e-7978c312cac2 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1318 microversion: 2.1 time: 0.260629 Jul 13 21:07:19.494952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 174/355] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:19 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:20.150269 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-5975d195-0864-4671-a270-c9dfabf7118b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:20.150952 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-5975d195-0864-4671-a270-c9dfabf7118b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:20.152904 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=2 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:07:20.158585 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5975d195-0864-4671-a270-c9dfabf7118b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:20.159051 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5975d195-0864-4671-a270-c9dfabf7118b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:20.159810 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5975d195-0864-4671-a270-c9dfabf7118b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:20.160243 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5975d195-0864-4671-a270-c9dfabf7118b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:20.164232 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-4a06c311-d79f-4bb9-98ed-a5da69dceb8c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:20.164836 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-4a06c311-d79f-4bb9-98ed-a5da69dceb8c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:20.170768 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4a06c311-d79f-4bb9-98ed-a5da69dceb8c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:20.171218 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4a06c311-d79f-4bb9-98ed-a5da69dceb8c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:20.171986 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4a06c311-d79f-4bb9-98ed-a5da69dceb8c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:20.172917 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4a06c311-d79f-4bb9-98ed-a5da69dceb8c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:20.315686 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5975d195-0864-4671-a270-c9dfabf7118b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:20.319637 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=100 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:07:20.324301 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-5975d195-0864-4671-a270-c9dfabf7118b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1358 microversion: 2.1 time: 0.178040 Jul 13 21:07:20.325060 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 182/356] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:20 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:20.384112 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-4a06c311-d79f-4bb9-98ed-a5da69dceb8c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:20.392284 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-4a06c311-d79f-4bb9-98ed-a5da69dceb8c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1321 microversion: 2.1 time: 0.231783 Jul 13 21:07:20.392860 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 175/357] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:20 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:07:20.513080 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-60058665-0361-4907-b49b-3dc3329bcec6 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:20.514052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-60058665-0361-4907-b49b-3dc3329bcec6 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:20.533129 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-60058665-0361-4907-b49b-3dc3329bcec6 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:20.533806 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-60058665-0361-4907-b49b-3dc3329bcec6 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:20.534687 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-60058665-0361-4907-b49b-3dc3329bcec6 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:20.535195 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-60058665-0361-4907-b49b-3dc3329bcec6 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:20.701488 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-60058665-0361-4907-b49b-3dc3329bcec6 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:20.709493 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-60058665-0361-4907-b49b-3dc3329bcec6 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1318 microversion: 2.1 time: 0.201218 Jul 13 21:07:20.710051 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 183/358] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:20 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:21.340616 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-25d5763d-2fdb-4e1a-a565-b2755afd7254 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:21.341764 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-25d5763d-2fdb-4e1a-a565-b2755afd7254 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:21.350348 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-25d5763d-2fdb-4e1a-a565-b2755afd7254 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:21.350841 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-25d5763d-2fdb-4e1a-a565-b2755afd7254 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:21.352457 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-25d5763d-2fdb-4e1a-a565-b2755afd7254 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:21.352909 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-25d5763d-2fdb-4e1a-a565-b2755afd7254 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:21.358539 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=100 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:07:21.412574 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-eadf6326-2f5b-4426-a80a-3a506cc93152 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:21.412574 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-eadf6326-2f5b-4426-a80a-3a506cc93152 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:21.422145 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-eadf6326-2f5b-4426-a80a-3a506cc93152 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:21.423377 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-eadf6326-2f5b-4426-a80a-3a506cc93152 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:21.424176 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-eadf6326-2f5b-4426-a80a-3a506cc93152 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:21.424638 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-eadf6326-2f5b-4426-a80a-3a506cc93152 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:21.508333 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-25d5763d-2fdb-4e1a-a565-b2755afd7254 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:21.515825 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-25d5763d-2fdb-4e1a-a565-b2755afd7254 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1358 microversion: 2.1 time: 0.179336 Jul 13 21:07:21.516924 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 176/359] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:21 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:21.611565 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-eadf6326-2f5b-4426-a80a-3a506cc93152 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:21.619776 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-eadf6326-2f5b-4426-a80a-3a506cc93152 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1321 microversion: 2.1 time: 0.214337 Jul 13 21:07:21.631514 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 184/360] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:21 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:21.726067 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-e4ee479e-7cd6-4145-a253-67942b13b041 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:21.726589 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-e4ee479e-7cd6-4145-a253-67942b13b041 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:21.732671 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e4ee479e-7cd6-4145-a253-67942b13b041 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:21.733120 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e4ee479e-7cd6-4145-a253-67942b13b041 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:21.733884 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e4ee479e-7cd6-4145-a253-67942b13b041 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:21.734330 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e4ee479e-7cd6-4145-a253-67942b13b041 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:21.890861 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-e4ee479e-7cd6-4145-a253-67942b13b041 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:21.902949 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-e4ee479e-7cd6-4145-a253-67942b13b041 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1318 microversion: 2.1 time: 0.180721 Jul 13 21:07:21.911122 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 177/361] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:21 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:22.535615 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-3ffa5ccb-70df-4fcd-bf42-e520b03d2888 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:22.536263 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-3ffa5ccb-70df-4fcd-bf42-e520b03d2888 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:22.540021 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:07:22.543841 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3ffa5ccb-70df-4fcd-bf42-e520b03d2888 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:22.544363 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3ffa5ccb-70df-4fcd-bf42-e520b03d2888 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:22.545223 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3ffa5ccb-70df-4fcd-bf42-e520b03d2888 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:22.545728 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3ffa5ccb-70df-4fcd-bf42-e520b03d2888 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:22.640012 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-54a8926f-3c21-4a28-9a6d-0180dc9cfcc9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:22.640617 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-54a8926f-3c21-4a28-9a6d-0180dc9cfcc9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:22.647526 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-54a8926f-3c21-4a28-9a6d-0180dc9cfcc9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:22.647976 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-54a8926f-3c21-4a28-9a6d-0180dc9cfcc9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:22.649000 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-54a8926f-3c21-4a28-9a6d-0180dc9cfcc9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:22.650215 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-54a8926f-3c21-4a28-9a6d-0180dc9cfcc9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:22.743584 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3ffa5ccb-70df-4fcd-bf42-e520b03d2888 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:22.751421 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-3ffa5ccb-70df-4fcd-bf42-e520b03d2888 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1358 microversion: 2.1 time: 0.220008 Jul 13 21:07:22.762057 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 185/362] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:22 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:22.808487 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-54a8926f-3c21-4a28-9a6d-0180dc9cfcc9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:22.815901 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-54a8926f-3c21-4a28-9a6d-0180dc9cfcc9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1321 microversion: 2.1 time: 0.179664 Jul 13 21:07:22.816493 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 178/363] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:22 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:07:22.920522 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-8e48f341-2bde-4c63-aca3-561fa016733c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:22.921387 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8e48f341-2bde-4c63-aca3-561fa016733c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:22.927956 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8e48f341-2bde-4c63-aca3-561fa016733c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:22.928504 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8e48f341-2bde-4c63-aca3-561fa016733c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:22.929422 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8e48f341-2bde-4c63-aca3-561fa016733c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:22.929917 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8e48f341-2bde-4c63-aca3-561fa016733c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:23.124186 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8e48f341-2bde-4c63-aca3-561fa016733c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:23.132261 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-8e48f341-2bde-4c63-aca3-561fa016733c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1318 microversion: 2.1 time: 0.216382 Jul 13 21:07:23.142222 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 186/364] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:22 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:23.768784 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-3b87ef34-65a9-4fe7-a9de-a64f4a6aceff tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:23.769364 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-3b87ef34-65a9-4fe7-a9de-a64f4a6aceff tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:23.775618 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3b87ef34-65a9-4fe7-a9de-a64f4a6aceff tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:23.776058 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3b87ef34-65a9-4fe7-a9de-a64f4a6aceff tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:23.776804 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3b87ef34-65a9-4fe7-a9de-a64f4a6aceff tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:23.777229 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3b87ef34-65a9-4fe7-a9de-a64f4a6aceff tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:23.833624 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-71e8903d-79a0-4288-9720-39ab3ccdade2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:23.834367 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-71e8903d-79a0-4288-9720-39ab3ccdade2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:23.865734 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-71e8903d-79a0-4288-9720-39ab3ccdade2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:23.866189 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-71e8903d-79a0-4288-9720-39ab3ccdade2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:23.867022 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-71e8903d-79a0-4288-9720-39ab3ccdade2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:23.867551 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-71e8903d-79a0-4288-9720-39ab3ccdade2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:23.928726 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-3b87ef34-65a9-4fe7-a9de-a64f4a6aceff tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:23.936634 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-3b87ef34-65a9-4fe7-a9de-a64f4a6aceff tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1358 microversion: 2.1 time: 0.171586 Jul 13 21:07:23.949181 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 179/365] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:23 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:24.041874 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-71e8903d-79a0-4288-9720-39ab3ccdade2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:24.049894 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-71e8903d-79a0-4288-9720-39ab3ccdade2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1321 microversion: 2.1 time: 0.220192 Jul 13 21:07:24.050449 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 187/366] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:23 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:07:24.150016 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-9f416a0d-85b9-4e42-a119-4efff80dfd90 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:24.150630 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-9f416a0d-85b9-4e42-a119-4efff80dfd90 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:24.157719 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9f416a0d-85b9-4e42-a119-4efff80dfd90 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:24.158401 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9f416a0d-85b9-4e42-a119-4efff80dfd90 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:24.160115 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9f416a0d-85b9-4e42-a119-4efff80dfd90 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:24.160704 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9f416a0d-85b9-4e42-a119-4efff80dfd90 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:24.300143 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-9f416a0d-85b9-4e42-a119-4efff80dfd90 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:24.308373 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-9f416a0d-85b9-4e42-a119-4efff80dfd90 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1318 microversion: 2.1 time: 0.162582 Jul 13 21:07:24.309272 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 180/367] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:24 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:24.954807 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-9ecbbae5-e8e2-497c-9ef2-3d598278c667 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:24.956293 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-9ecbbae5-e8e2-497c-9ef2-3d598278c667 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:24.961895 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=10 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:07:24.971368 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9ecbbae5-e8e2-497c-9ef2-3d598278c667 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:24.972161 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9ecbbae5-e8e2-497c-9ef2-3d598278c667 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:24.973189 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9ecbbae5-e8e2-497c-9ef2-3d598278c667 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:24.973829 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9ecbbae5-e8e2-497c-9ef2-3d598278c667 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:25.067833 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-987a94b3-abbc-40ca-bc6c-cf97b0b50af6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:25.068466 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-987a94b3-abbc-40ca-bc6c-cf97b0b50af6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:25.075201 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-987a94b3-abbc-40ca-bc6c-cf97b0b50af6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:25.075722 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-987a94b3-abbc-40ca-bc6c-cf97b0b50af6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:25.076563 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-987a94b3-abbc-40ca-bc6c-cf97b0b50af6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:25.077063 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-987a94b3-abbc-40ca-bc6c-cf97b0b50af6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:25.144073 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-9ecbbae5-e8e2-497c-9ef2-3d598278c667 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:25.154652 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-9ecbbae5-e8e2-497c-9ef2-3d598278c667 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1358 microversion: 2.1 time: 0.205025 Jul 13 21:07:25.163668 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 188/368] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:24 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:25.262169 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-987a94b3-abbc-40ca-bc6c-cf97b0b50af6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:25.269715 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-987a94b3-abbc-40ca-bc6c-cf97b0b50af6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1321 microversion: 2.1 time: 0.206386 Jul 13 21:07:25.270288 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 181/369] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:25 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:07:25.324895 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-3534ca87-b3ec-45b2-b625-f5d0c0c9df07 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:25.325975 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-3534ca87-b3ec-45b2-b625-f5d0c0c9df07 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:25.332711 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3534ca87-b3ec-45b2-b625-f5d0c0c9df07 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:25.333484 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3534ca87-b3ec-45b2-b625-f5d0c0c9df07 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:25.334511 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3534ca87-b3ec-45b2-b625-f5d0c0c9df07 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:25.335052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3534ca87-b3ec-45b2-b625-f5d0c0c9df07 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:25.466035 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3534ca87-b3ec-45b2-b625-f5d0c0c9df07 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:25.474311 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-3534ca87-b3ec-45b2-b625-f5d0c0c9df07 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1318 microversion: 2.1 time: 0.153558 Jul 13 21:07:25.475006 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 189/370] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:25 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:26.171028 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b6c94801-15cb-4418-b44f-4db949b01144 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:26.171634 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b6c94801-15cb-4418-b44f-4db949b01144 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:26.173582 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell0:SELECT=2 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:07:26.174435 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell0:SELECT=10 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:07:26.175636 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:07:26.182434 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b6c94801-15cb-4418-b44f-4db949b01144 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:26.182984 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b6c94801-15cb-4418-b44f-4db949b01144 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:26.183757 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b6c94801-15cb-4418-b44f-4db949b01144 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:26.184358 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b6c94801-15cb-4418-b44f-4db949b01144 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:26.290799 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-7ee616f8-6dc2-4328-8020-42a7c9f115d2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:26.292173 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-7ee616f8-6dc2-4328-8020-42a7c9f115d2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:26.298879 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7ee616f8-6dc2-4328-8020-42a7c9f115d2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:26.299302 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7ee616f8-6dc2-4328-8020-42a7c9f115d2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:26.301968 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7ee616f8-6dc2-4328-8020-42a7c9f115d2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:26.302458 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7ee616f8-6dc2-4328-8020-42a7c9f115d2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:26.370293 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b6c94801-15cb-4418-b44f-4db949b01144 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:26.379302 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b6c94801-15cb-4418-b44f-4db949b01144 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1358 microversion: 2.1 time: 0.212175 Jul 13 21:07:26.380261 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 182/371] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:26 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:26.457269 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-7ee616f8-6dc2-4328-8020-42a7c9f115d2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:26.466175 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-7ee616f8-6dc2-4328-8020-42a7c9f115d2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1321 microversion: 2.1 time: 0.183606 Jul 13 21:07:26.466919 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 190/372] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:26 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:07:26.492949 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-32a5a257-fd47-4cd4-a550-265ba91b0c95 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:26.494302 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-32a5a257-fd47-4cd4-a550-265ba91b0c95 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:26.504155 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-32a5a257-fd47-4cd4-a550-265ba91b0c95 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:26.504711 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-32a5a257-fd47-4cd4-a550-265ba91b0c95 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:26.505777 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-32a5a257-fd47-4cd4-a550-265ba91b0c95 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:26.506326 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-32a5a257-fd47-4cd4-a550-265ba91b0c95 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:26.670598 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-32a5a257-fd47-4cd4-a550-265ba91b0c95 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:26.678448 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-32a5a257-fd47-4cd4-a550-265ba91b0c95 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1318 microversion: 2.1 time: 0.190424 Jul 13 21:07:26.679048 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 183/373] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:26 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:27.397003 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-b0fdd9dc-a6ed-4d6c-af55-29bb8d211dea tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:27.397743 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-b0fdd9dc-a6ed-4d6c-af55-29bb8d211dea tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:27.405373 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b0fdd9dc-a6ed-4d6c-af55-29bb8d211dea tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:27.406114 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b0fdd9dc-a6ed-4d6c-af55-29bb8d211dea tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:27.407826 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b0fdd9dc-a6ed-4d6c-af55-29bb8d211dea tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:27.408765 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b0fdd9dc-a6ed-4d6c-af55-29bb8d211dea tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:27.483063 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-dd8b1d94-f864-41c1-a270-29d8c313de33 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:27.484398 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-dd8b1d94-f864-41c1-a270-29d8c313de33 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:27.491871 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-dd8b1d94-f864-41c1-a270-29d8c313de33 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:27.492572 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-dd8b1d94-f864-41c1-a270-29d8c313de33 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:27.493624 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-dd8b1d94-f864-41c1-a270-29d8c313de33 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:27.494286 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-dd8b1d94-f864-41c1-a270-29d8c313de33 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:27.547035 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b0fdd9dc-a6ed-4d6c-af55-29bb8d211dea tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:27.554847 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-b0fdd9dc-a6ed-4d6c-af55-29bb8d211dea tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1358 microversion: 2.1 time: 0.161883 Jul 13 21:07:27.558080 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 191/374] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:27 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:27.636548 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-dd8b1d94-f864-41c1-a270-29d8c313de33 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:27.644786 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-dd8b1d94-f864-41c1-a270-29d8c313de33 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1321 microversion: 2.1 time: 0.165487 Jul 13 21:07:27.645952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 184/375] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:27 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:07:27.694875 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-6378c4bd-ea97-4d89-b5f7-f6882c4d4452 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:27.695466 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-6378c4bd-ea97-4d89-b5f7-f6882c4d4452 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:27.701620 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6378c4bd-ea97-4d89-b5f7-f6882c4d4452 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:27.702062 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6378c4bd-ea97-4d89-b5f7-f6882c4d4452 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:27.702859 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6378c4bd-ea97-4d89-b5f7-f6882c4d4452 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:27.703357 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6378c4bd-ea97-4d89-b5f7-f6882c4d4452 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:27.839728 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-6378c4bd-ea97-4d89-b5f7-f6882c4d4452 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:27.848751 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-6378c4bd-ea97-4d89-b5f7-f6882c4d4452 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1318 microversion: 2.1 time: 0.157791 Jul 13 21:07:27.849327 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 192/376] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:27 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:28.571555 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0497e12e-3770-48b8-8b4d-d8a7937e21db tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:28.572085 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-0497e12e-3770-48b8-8b4d-d8a7937e21db tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:28.578188 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0497e12e-3770-48b8-8b4d-d8a7937e21db tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:28.578658 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0497e12e-3770-48b8-8b4d-d8a7937e21db tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:28.580123 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0497e12e-3770-48b8-8b4d-d8a7937e21db tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:28.580565 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0497e12e-3770-48b8-8b4d-d8a7937e21db tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:28.661395 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-67bc429d-8a35-48a9-8356-1cfc86d71e44 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:28.662056 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-67bc429d-8a35-48a9-8356-1cfc86d71e44 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:28.668067 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-67bc429d-8a35-48a9-8356-1cfc86d71e44 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:28.668509 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-67bc429d-8a35-48a9-8356-1cfc86d71e44 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:28.669260 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-67bc429d-8a35-48a9-8356-1cfc86d71e44 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:28.669689 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-67bc429d-8a35-48a9-8356-1cfc86d71e44 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:28.724175 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-0497e12e-3770-48b8-8b4d-d8a7937e21db tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:28.731990 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-0497e12e-3770-48b8-8b4d-d8a7937e21db tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1358 microversion: 2.1 time: 0.164361 Jul 13 21:07:28.732555 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 185/377] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:28 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:28.803469 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-67bc429d-8a35-48a9-8356-1cfc86d71e44 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:28.811506 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-67bc429d-8a35-48a9-8356-1cfc86d71e44 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1321 microversion: 2.1 time: 0.154032 Jul 13 21:07:28.812315 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 193/378] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:28 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:07:28.866048 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0b5f9a18-b9ec-471e-9d27-3268048ce605 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:28.866854 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-0b5f9a18-b9ec-471e-9d27-3268048ce605 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:28.873778 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0b5f9a18-b9ec-471e-9d27-3268048ce605 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:28.874568 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0b5f9a18-b9ec-471e-9d27-3268048ce605 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:28.875457 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0b5f9a18-b9ec-471e-9d27-3268048ce605 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:28.876574 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0b5f9a18-b9ec-471e-9d27-3268048ce605 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:29.009068 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-0b5f9a18-b9ec-471e-9d27-3268048ce605 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:29.017051 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-0b5f9a18-b9ec-471e-9d27-3268048ce605 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1318 microversion: 2.1 time: 0.154961 Jul 13 21:07:29.017829 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 186/379] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:28 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:29.749297 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-e77d2364-c8ae-4baf-984c-5599b28e47ac tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:29.750003 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-e77d2364-c8ae-4baf-984c-5599b28e47ac tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:29.756582 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e77d2364-c8ae-4baf-984c-5599b28e47ac tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:29.757109 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e77d2364-c8ae-4baf-984c-5599b28e47ac tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:29.757947 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e77d2364-c8ae-4baf-984c-5599b28e47ac tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:29.758451 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e77d2364-c8ae-4baf-984c-5599b28e47ac tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:29.831103 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-da8f15b1-9c7d-4fe4-b793-4ffc6118785e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:29.831663 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-da8f15b1-9c7d-4fe4-b793-4ffc6118785e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:29.837836 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-da8f15b1-9c7d-4fe4-b793-4ffc6118785e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:29.838288 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-da8f15b1-9c7d-4fe4-b793-4ffc6118785e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:29.839086 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-da8f15b1-9c7d-4fe4-b793-4ffc6118785e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:29.839518 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-da8f15b1-9c7d-4fe4-b793-4ffc6118785e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:29.902656 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-e77d2364-c8ae-4baf-984c-5599b28e47ac tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:29.910835 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-e77d2364-c8ae-4baf-984c-5599b28e47ac tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1358 microversion: 2.1 time: 0.165421 Jul 13 21:07:29.911413 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 194/380] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:29 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:29.981576 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-da8f15b1-9c7d-4fe4-b793-4ffc6118785e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:29.989014 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-da8f15b1-9c7d-4fe4-b793-4ffc6118785e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1321 microversion: 2.1 time: 0.163810 Jul 13 21:07:29.989584 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 187/381] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:29 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:30.033448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-b966f09e-7a19-4af9-a06f-04d3118dde7c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:30.034054 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-b966f09e-7a19-4af9-a06f-04d3118dde7c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:30.040059 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b966f09e-7a19-4af9-a06f-04d3118dde7c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:30.040404 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b966f09e-7a19-4af9-a06f-04d3118dde7c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:30.041161 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b966f09e-7a19-4af9-a06f-04d3118dde7c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:30.041596 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b966f09e-7a19-4af9-a06f-04d3118dde7c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:30.170883 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b966f09e-7a19-4af9-a06f-04d3118dde7c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:30.178287 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-b966f09e-7a19-4af9-a06f-04d3118dde7c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1318 microversion: 2.1 time: 0.149041 Jul 13 21:07:30.178893 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 195/382] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:30 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:30.927986 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-8144b636-5384-4b73-a6e5-62b98eb288d9 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:30.928627 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-8144b636-5384-4b73-a6e5-62b98eb288d9 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:30.934539 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8144b636-5384-4b73-a6e5-62b98eb288d9 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:30.935014 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8144b636-5384-4b73-a6e5-62b98eb288d9 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:30.935760 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8144b636-5384-4b73-a6e5-62b98eb288d9 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:30.936189 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8144b636-5384-4b73-a6e5-62b98eb288d9 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:31.005229 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-4cede493-378e-445e-b2c9-c959d71ebffd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:31.005827 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-4cede493-378e-445e-b2c9-c959d71ebffd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:31.012300 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4cede493-378e-445e-b2c9-c959d71ebffd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:31.012740 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4cede493-378e-445e-b2c9-c959d71ebffd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:31.013495 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4cede493-378e-445e-b2c9-c959d71ebffd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:31.013924 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4cede493-378e-445e-b2c9-c959d71ebffd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:31.066732 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-8144b636-5384-4b73-a6e5-62b98eb288d9 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:31.074094 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-8144b636-5384-4b73-a6e5-62b98eb288d9 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1358 microversion: 2.1 time: 0.149883 Jul 13 21:07:31.074672 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 188/383] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:30 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:31.144487 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-4cede493-378e-445e-b2c9-c959d71ebffd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:31.152102 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-4cede493-378e-445e-b2c9-c959d71ebffd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1321 microversion: 2.1 time: 0.150677 Jul 13 21:07:31.152875 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 196/384] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:31 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:31.194880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0bf11072-0218-4be7-a15c-a85487dad9fc tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:31.195478 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-0bf11072-0218-4be7-a15c-a85487dad9fc tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:31.201709 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0bf11072-0218-4be7-a15c-a85487dad9fc tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:31.202151 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0bf11072-0218-4be7-a15c-a85487dad9fc tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:31.202926 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0bf11072-0218-4be7-a15c-a85487dad9fc tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:31.203359 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0bf11072-0218-4be7-a15c-a85487dad9fc tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:31.330385 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-0bf11072-0218-4be7-a15c-a85487dad9fc tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:31.337750 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-0bf11072-0218-4be7-a15c-a85487dad9fc tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1318 microversion: 2.1 time: 0.146699 Jul 13 21:07:31.338321 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 189/385] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:31 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:32.091934 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-0376a858-c578-451a-b001-2a6cc4a1cdbd tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:32.092469 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-0376a858-c578-451a-b001-2a6cc4a1cdbd tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:32.098875 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0376a858-c578-451a-b001-2a6cc4a1cdbd tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:32.099318 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0376a858-c578-451a-b001-2a6cc4a1cdbd tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:32.100074 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0376a858-c578-451a-b001-2a6cc4a1cdbd tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:32.100506 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0376a858-c578-451a-b001-2a6cc4a1cdbd tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:32.169218 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-7d3932af-6c07-4260-aa1c-c097b5b32259 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:32.169811 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-7d3932af-6c07-4260-aa1c-c097b5b32259 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:32.176458 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7d3932af-6c07-4260-aa1c-c097b5b32259 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:32.176911 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7d3932af-6c07-4260-aa1c-c097b5b32259 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:32.177676 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7d3932af-6c07-4260-aa1c-c097b5b32259 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:32.178114 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7d3932af-6c07-4260-aa1c-c097b5b32259 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:32.230112 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-0376a858-c578-451a-b001-2a6cc4a1cdbd tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:32.238171 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-0376a858-c578-451a-b001-2a6cc4a1cdbd tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1358 microversion: 2.1 time: 0.150554 Jul 13 21:07:32.238755 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 197/386] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:32 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:32.308968 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-7d3932af-6c07-4260-aa1c-c097b5b32259 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:32.316351 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-7d3932af-6c07-4260-aa1c-c097b5b32259 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1321 microversion: 2.1 time: 0.150958 Jul 13 21:07:32.316939 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 190/387] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:32 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:07:32.354828 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-70fc0630-cd0f-4f95-9b7e-711bebf9d746 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:32.355367 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-70fc0630-cd0f-4f95-9b7e-711bebf9d746 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:32.362034 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-70fc0630-cd0f-4f95-9b7e-711bebf9d746 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:32.362479 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-70fc0630-cd0f-4f95-9b7e-711bebf9d746 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:32.363260 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-70fc0630-cd0f-4f95-9b7e-711bebf9d746 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:32.363692 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-70fc0630-cd0f-4f95-9b7e-711bebf9d746 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:32.486064 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-70fc0630-cd0f-4f95-9b7e-711bebf9d746 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:32.493507 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-70fc0630-cd0f-4f95-9b7e-711bebf9d746 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1318 microversion: 2.1 time: 0.142546 Jul 13 21:07:32.494066 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 198/388] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:32 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:33.254218 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-429d00ea-414e-4382-a3ed-9524cc191d99 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:33.254849 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-429d00ea-414e-4382-a3ed-9524cc191d99 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:33.260780 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-429d00ea-414e-4382-a3ed-9524cc191d99 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:33.261219 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-429d00ea-414e-4382-a3ed-9524cc191d99 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:33.261996 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-429d00ea-414e-4382-a3ed-9524cc191d99 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:33.262429 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-429d00ea-414e-4382-a3ed-9524cc191d99 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:33.333219 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-be00e63e-d449-4143-a68c-0222b69a25b8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:33.333940 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-be00e63e-d449-4143-a68c-0222b69a25b8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:33.340659 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-be00e63e-d449-4143-a68c-0222b69a25b8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:33.341106 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-be00e63e-d449-4143-a68c-0222b69a25b8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:33.341875 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-be00e63e-d449-4143-a68c-0222b69a25b8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:33.342308 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-be00e63e-d449-4143-a68c-0222b69a25b8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:33.360583 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=100 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:07:33.388322 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-429d00ea-414e-4382-a3ed-9524cc191d99 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:33.395862 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-429d00ea-414e-4382-a3ed-9524cc191d99 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1358 microversion: 2.1 time: 0.145647 Jul 13 21:07:33.396425 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 191/389] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:33 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:33.474654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-be00e63e-d449-4143-a68c-0222b69a25b8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:33.481963 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-be00e63e-d449-4143-a68c-0222b69a25b8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1321 microversion: 2.1 time: 0.152717 Jul 13 21:07:33.482460 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 199/390] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:33 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:07:33.509025 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-4cd69898-d189-45b5-9269-2a2876536c21 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:33.509619 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-4cd69898-d189-45b5-9269-2a2876536c21 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:33.515882 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4cd69898-d189-45b5-9269-2a2876536c21 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:33.516327 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4cd69898-d189-45b5-9269-2a2876536c21 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:33.517071 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4cd69898-d189-45b5-9269-2a2876536c21 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:33.517500 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4cd69898-d189-45b5-9269-2a2876536c21 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:33.641105 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-4cd69898-d189-45b5-9269-2a2876536c21 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:33.644506 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=100 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:07:33.649173 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-4cd69898-d189-45b5-9269-2a2876536c21 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1318 microversion: 2.1 time: 0.143924 Jul 13 21:07:33.649728 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 192/391] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:33 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:34.413650 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-16c8b311-5885-4a8b-bf81-62efead950b0 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:34.414241 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-16c8b311-5885-4a8b-bf81-62efead950b0 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:34.421071 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-16c8b311-5885-4a8b-bf81-62efead950b0 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:34.421601 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-16c8b311-5885-4a8b-bf81-62efead950b0 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:34.422693 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-16c8b311-5885-4a8b-bf81-62efead950b0 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:34.423296 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-16c8b311-5885-4a8b-bf81-62efead950b0 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:34.498925 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ec5a22c7-3ad9-45cb-849e-526378ff10c1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:34.499524 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-ec5a22c7-3ad9-45cb-849e-526378ff10c1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:34.507265 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ec5a22c7-3ad9-45cb-849e-526378ff10c1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:34.508023 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ec5a22c7-3ad9-45cb-849e-526378ff10c1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:34.509024 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ec5a22c7-3ad9-45cb-849e-526378ff10c1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:34.509691 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ec5a22c7-3ad9-45cb-849e-526378ff10c1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:34.578297 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-16c8b311-5885-4a8b-bf81-62efead950b0 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:34.588208 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-16c8b311-5885-4a8b-bf81-62efead950b0 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1358 microversion: 2.1 time: 0.178511 Jul 13 21:07:34.588822 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 200/392] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:34 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:34.595902 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-2653cd33-c603-4aa7-9992-c5b53c0f429f req-08b2ce92-26ac-4223-8d1d-13a2f0ddb976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b38afa70-d071-4833-bebb-86a20e1ee786", "tag": "0cafa13d-1a14-44df-9c31-93ee2dc5a8a0"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:07:34.605857 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-2653cd33-c603-4aa7-9992-c5b53c0f429f req-08b2ce92-26ac-4223-8d1d-13a2f0ddb976 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:34.606374 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-2653cd33-c603-4aa7-9992-c5b53c0f429f req-08b2ce92-26ac-4223-8d1d-13a2f0ddb976 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:34.623129 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-2653cd33-c603-4aa7-9992-c5b53c0f429f req-08b2ce92-26ac-4223-8d1d-13a2f0ddb976 service nova] Creating event network-changed:0cafa13d-1a14-44df-9c31-93ee2dc5a8a0 for instance b38afa70-d071-4833-bebb-86a20e1ee786 on hv-cinder-79987 Jul 13 21:07:34.632826 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-2653cd33-c603-4aa7-9992-c5b53c0f429f req-08b2ce92-26ac-4223-8d1d-13a2f0ddb976 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042447 Jul 13 21:07:34.633650 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 201/393] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:07:34.666729 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-3a767f6e-f9ef-4031-8e3e-34a7cff4c51d tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:34.667443 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-3a767f6e-f9ef-4031-8e3e-34a7cff4c51d tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:34.674037 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3a767f6e-f9ef-4031-8e3e-34a7cff4c51d tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:34.674871 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3a767f6e-f9ef-4031-8e3e-34a7cff4c51d tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:34.675642 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3a767f6e-f9ef-4031-8e3e-34a7cff4c51d tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:34.676244 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3a767f6e-f9ef-4031-8e3e-34a7cff4c51d tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:34.793859 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ec5a22c7-3ad9-45cb-849e-526378ff10c1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:34.801791 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ec5a22c7-3ad9-45cb-849e-526378ff10c1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1321 microversion: 2.1 time: 0.306528 Jul 13 21:07:34.811897 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 193/394] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:34 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1321 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:07:34.813157 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3a767f6e-f9ef-4031-8e3e-34a7cff4c51d tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:34.821390 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-3a767f6e-f9ef-4031-8e3e-34a7cff4c51d tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1318 microversion: 2.1 time: 0.158896 Jul 13 21:07:34.821952 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 202/395] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:34 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:07:35.605280 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-a289d464-5c6b-4fb2-90f1-c3deea469085 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:35.605964 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-a289d464-5c6b-4fb2-90f1-c3deea469085 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:35.611905 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a289d464-5c6b-4fb2-90f1-c3deea469085 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:35.612354 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a289d464-5c6b-4fb2-90f1-c3deea469085 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:35.613107 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a289d464-5c6b-4fb2-90f1-c3deea469085 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:35.613546 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a289d464-5c6b-4fb2-90f1-c3deea469085 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:35.739389 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-a289d464-5c6b-4fb2-90f1-c3deea469085 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:35.746597 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-a289d464-5c6b-4fb2-90f1-c3deea469085 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1358 microversion: 2.1 time: 0.145241 Jul 13 21:07:35.747182 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 194/396] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:35 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:35.819046 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-31813008-e93d-422b-ac0d-bc1064fa89cd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:35.819646 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-31813008-e93d-422b-ac0d-bc1064fa89cd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:35.826140 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-31813008-e93d-422b-ac0d-bc1064fa89cd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:35.826584 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-31813008-e93d-422b-ac0d-bc1064fa89cd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:35.827362 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-31813008-e93d-422b-ac0d-bc1064fa89cd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:35.827818 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-31813008-e93d-422b-ac0d-bc1064fa89cd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:35.836881 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-a00e5eef-b5d6-4585-ac1a-dfb8d035fea7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:35.837481 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-a00e5eef-b5d6-4585-ac1a-dfb8d035fea7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:35.843337 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a00e5eef-b5d6-4585-ac1a-dfb8d035fea7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:35.843779 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a00e5eef-b5d6-4585-ac1a-dfb8d035fea7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:35.845118 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a00e5eef-b5d6-4585-ac1a-dfb8d035fea7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:35.845547 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a00e5eef-b5d6-4585-ac1a-dfb8d035fea7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:35.954705 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-31813008-e93d-422b-ac0d-bc1064fa89cd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:35.962086 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-31813008-e93d-422b-ac0d-bc1064fa89cd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1515 microversion: 2.1 time: 0.146828 Jul 13 21:07:35.962873 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 203/397] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:35 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1515 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:35.973776 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-a00e5eef-b5d6-4585-ac1a-dfb8d035fea7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:35.978134 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-a7bf65af-e85c-460d-be0b-dc8ad14e37d7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:07:35.979140 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-a7bf65af-e85c-460d-be0b-dc8ad14e37d7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:35.981131 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-a00e5eef-b5d6-4585-ac1a-dfb8d035fea7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1318 microversion: 2.1 time: 0.147993 Jul 13 21:07:35.982151 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 195/398] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:35 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:07:35.985046 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a7bf65af-e85c-460d-be0b-dc8ad14e37d7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:35.985501 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a7bf65af-e85c-460d-be0b-dc8ad14e37d7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:35.986263 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a7bf65af-e85c-460d-be0b-dc8ad14e37d7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:35.986801 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a7bf65af-e85c-460d-be0b-dc8ad14e37d7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:36.009068 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.objects.instance [None req-a7bf65af-e85c-460d-be0b-dc8ad14e37d7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lazy-loading 'flavor' on Instance uuid 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea {{(pid=118445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:07:36.119176 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-a7bf65af-e85c-460d-be0b-dc8ad14e37d7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "POST /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea/action" status: 200 len: 32 microversion: 2.1 time: 0.144788 Jul 13 21:07:36.119790 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 204/399] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Jul 13 21:07:35 2022] POST /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea/action => generated 32 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 13 21:07:36.129239 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-fea01643-552d-4abc-b855-8f14201ec5da tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:36.129846 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-fea01643-552d-4abc-b855-8f14201ec5da tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:36.135748 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fea01643-552d-4abc-b855-8f14201ec5da tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:36.136195 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fea01643-552d-4abc-b855-8f14201ec5da tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:36.136949 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fea01643-552d-4abc-b855-8f14201ec5da tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:36.137383 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fea01643-552d-4abc-b855-8f14201ec5da tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:36.260543 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-fea01643-552d-4abc-b855-8f14201ec5da tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:36.268824 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-fea01643-552d-4abc-b855-8f14201ec5da tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.143863 Jul 13 21:07:36.269388 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 196/400] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:36 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:36.763701 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-b7f71ee1-a283-430c-8ff0-83c4c0ed4a80 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:36.764395 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-b7f71ee1-a283-430c-8ff0-83c4c0ed4a80 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:36.771468 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b7f71ee1-a283-430c-8ff0-83c4c0ed4a80 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:36.771914 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b7f71ee1-a283-430c-8ff0-83c4c0ed4a80 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:36.772666 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b7f71ee1-a283-430c-8ff0-83c4c0ed4a80 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:36.773097 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b7f71ee1-a283-430c-8ff0-83c4c0ed4a80 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:36.896362 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b7f71ee1-a283-430c-8ff0-83c4c0ed4a80 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:36.903731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-b7f71ee1-a283-430c-8ff0-83c4c0ed4a80 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1358 microversion: 2.1 time: 0.144224 Jul 13 21:07:36.904281 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 205/401] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:36 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:36.997970 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-194ddf8a-1877-4879-9571-3f51172823e7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:36.998508 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-194ddf8a-1877-4879-9571-3f51172823e7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:37.004990 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-194ddf8a-1877-4879-9571-3f51172823e7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:37.005436 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-194ddf8a-1877-4879-9571-3f51172823e7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:37.006186 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-194ddf8a-1877-4879-9571-3f51172823e7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:37.006650 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-194ddf8a-1877-4879-9571-3f51172823e7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:37.134605 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-194ddf8a-1877-4879-9571-3f51172823e7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:37.141930 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-194ddf8a-1877-4879-9571-3f51172823e7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1318 microversion: 2.1 time: 0.147975 Jul 13 21:07:37.142490 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 197/402] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:36 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:37.285267 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-9ebdb519-cd24-4a60-9109-086ebd9a5dcf tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:37.285883 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-9ebdb519-cd24-4a60-9109-086ebd9a5dcf tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:37.291994 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9ebdb519-cd24-4a60-9109-086ebd9a5dcf tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:37.292460 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9ebdb519-cd24-4a60-9109-086ebd9a5dcf tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:37.293201 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9ebdb519-cd24-4a60-9109-086ebd9a5dcf tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:37.293637 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9ebdb519-cd24-4a60-9109-086ebd9a5dcf tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:37.421441 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-9ebdb519-cd24-4a60-9109-086ebd9a5dcf tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:37.429469 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-9ebdb519-cd24-4a60-9109-086ebd9a5dcf tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.148037 Jul 13 21:07:37.430029 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 206/403] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:37 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:37.920747 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-c10fb6ec-ea22-4937-913f-293d0444f057 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:37.921356 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-c10fb6ec-ea22-4937-913f-293d0444f057 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:37.927308 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c10fb6ec-ea22-4937-913f-293d0444f057 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:37.927750 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c10fb6ec-ea22-4937-913f-293d0444f057 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:37.928500 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c10fb6ec-ea22-4937-913f-293d0444f057 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:37.928935 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c10fb6ec-ea22-4937-913f-293d0444f057 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:38.052762 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-c10fb6ec-ea22-4937-913f-293d0444f057 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:38.060004 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-c10fb6ec-ea22-4937-913f-293d0444f057 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1358 microversion: 2.1 time: 0.143095 Jul 13 21:07:38.060559 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 198/404] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:37 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1358 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:38.159401 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-bafb4eae-ed66-48a2-b76c-4df757e02364 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:38.160106 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-bafb4eae-ed66-48a2-b76c-4df757e02364 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:38.167456 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bafb4eae-ed66-48a2-b76c-4df757e02364 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:38.167667 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bafb4eae-ed66-48a2-b76c-4df757e02364 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:38.168520 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bafb4eae-ed66-48a2-b76c-4df757e02364 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:38.169075 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bafb4eae-ed66-48a2-b76c-4df757e02364 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:38.301770 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-bafb4eae-ed66-48a2-b76c-4df757e02364 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:38.309724 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-bafb4eae-ed66-48a2-b76c-4df757e02364 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1318 microversion: 2.1 time: 0.154553 Jul 13 21:07:38.310172 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 207/405] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:38 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:38.447096 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-4e3edf0b-951a-41a0-9be1-d0c1dee28522 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:38.447706 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-4e3edf0b-951a-41a0-9be1-d0c1dee28522 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:38.454502 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4e3edf0b-951a-41a0-9be1-d0c1dee28522 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:38.454985 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4e3edf0b-951a-41a0-9be1-d0c1dee28522 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:38.455761 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4e3edf0b-951a-41a0-9be1-d0c1dee28522 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:38.456197 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4e3edf0b-951a-41a0-9be1-d0c1dee28522 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:38.582640 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-4e3edf0b-951a-41a0-9be1-d0c1dee28522 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:38.589942 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-4e3edf0b-951a-41a0-9be1-d0c1dee28522 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.147284 Jul 13 21:07:38.590502 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 199/406] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:38 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:39.076045 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-65b96819-a535-400b-8c74-56c099793489 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:39.076644 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-65b96819-a535-400b-8c74-56c099793489 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:39.082566 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-65b96819-a535-400b-8c74-56c099793489 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:39.083024 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-65b96819-a535-400b-8c74-56c099793489 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:39.083764 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-65b96819-a535-400b-8c74-56c099793489 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:39.084195 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-65b96819-a535-400b-8c74-56c099793489 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:39.209969 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-65b96819-a535-400b-8c74-56c099793489 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:39.217210 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-65b96819-a535-400b-8c74-56c099793489 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1358 microversion: 2.1 time: 0.144981 Jul 13 21:07:39.217756 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 208/407] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:39 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:07:39.326214 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-4635e099-8145-40a1-858e-c9925d1be5cf tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:39.326778 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-4635e099-8145-40a1-858e-c9925d1be5cf tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:39.333212 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4635e099-8145-40a1-858e-c9925d1be5cf tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:39.333660 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4635e099-8145-40a1-858e-c9925d1be5cf tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:39.334401 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4635e099-8145-40a1-858e-c9925d1be5cf tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:39.334871 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4635e099-8145-40a1-858e-c9925d1be5cf tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:39.456312 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-4635e099-8145-40a1-858e-c9925d1be5cf tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:39.463518 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-4635e099-8145-40a1-858e-c9925d1be5cf tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1318 microversion: 2.1 time: 0.141128 Jul 13 21:07:39.464073 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 200/408] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:39 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:39.606492 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-527057aa-0d89-452a-a84b-e138343f2596 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:39.607063 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-527057aa-0d89-452a-a84b-e138343f2596 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:39.612992 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-527057aa-0d89-452a-a84b-e138343f2596 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:39.613435 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-527057aa-0d89-452a-a84b-e138343f2596 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:39.614189 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-527057aa-0d89-452a-a84b-e138343f2596 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:39.614634 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-527057aa-0d89-452a-a84b-e138343f2596 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:39.744898 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-527057aa-0d89-452a-a84b-e138343f2596 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:39.753401 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-527057aa-0d89-452a-a84b-e138343f2596 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.150761 Jul 13 21:07:39.753972 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 209/409] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:39 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:40.234337 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-626ae60d-d58a-424d-b8c2-8bf5217b5e39 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:40.235485 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-626ae60d-d58a-424d-b8c2-8bf5217b5e39 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:40.241428 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-626ae60d-d58a-424d-b8c2-8bf5217b5e39 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:40.241869 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-626ae60d-d58a-424d-b8c2-8bf5217b5e39 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:40.242610 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-626ae60d-d58a-424d-b8c2-8bf5217b5e39 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:40.243063 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-626ae60d-d58a-424d-b8c2-8bf5217b5e39 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:40.371350 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-626ae60d-d58a-424d-b8c2-8bf5217b5e39 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:40.379824 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-626ae60d-d58a-424d-b8c2-8bf5217b5e39 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1358 microversion: 2.1 time: 0.149168 Jul 13 21:07:40.380420 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 201/410] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:40 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:40.480120 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-3a089ad5-4dcf-45c6-9fcc-5af97de6bff8 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:40.480867 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-3a089ad5-4dcf-45c6-9fcc-5af97de6bff8 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:40.488009 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3a089ad5-4dcf-45c6-9fcc-5af97de6bff8 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:40.488402 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3a089ad5-4dcf-45c6-9fcc-5af97de6bff8 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:40.489158 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3a089ad5-4dcf-45c6-9fcc-5af97de6bff8 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:40.489588 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3a089ad5-4dcf-45c6-9fcc-5af97de6bff8 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:40.613522 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3a089ad5-4dcf-45c6-9fcc-5af97de6bff8 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:40.620882 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-3a089ad5-4dcf-45c6-9fcc-5af97de6bff8 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1318 microversion: 2.1 time: 0.144642 Jul 13 21:07:40.621436 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 210/411] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:40 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:40.770230 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-bbd12ebd-ce46-4d38-b7da-b502a14f983b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:40.771063 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-bbd12ebd-ce46-4d38-b7da-b502a14f983b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:40.777051 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bbd12ebd-ce46-4d38-b7da-b502a14f983b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:40.777500 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bbd12ebd-ce46-4d38-b7da-b502a14f983b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:40.778256 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bbd12ebd-ce46-4d38-b7da-b502a14f983b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:40.778720 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bbd12ebd-ce46-4d38-b7da-b502a14f983b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:40.908922 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-bbd12ebd-ce46-4d38-b7da-b502a14f983b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:40.916363 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-bbd12ebd-ce46-4d38-b7da-b502a14f983b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.150013 Jul 13 21:07:40.916927 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 202/412] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:40 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:41.397859 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-73d47287-ed5e-455a-8696-ba4aa787cddb tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:41.398749 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-73d47287-ed5e-455a-8696-ba4aa787cddb tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:41.404880 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-73d47287-ed5e-455a-8696-ba4aa787cddb tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:41.405406 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-73d47287-ed5e-455a-8696-ba4aa787cddb tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:41.406267 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-73d47287-ed5e-455a-8696-ba4aa787cddb tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:41.406764 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-73d47287-ed5e-455a-8696-ba4aa787cddb tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:41.637277 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-c8530557-488f-4073-8d1b-7951ad9777b5 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:41.637933 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-c8530557-488f-4073-8d1b-7951ad9777b5 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:41.645148 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c8530557-488f-4073-8d1b-7951ad9777b5 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:41.645953 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c8530557-488f-4073-8d1b-7951ad9777b5 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:41.646843 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c8530557-488f-4073-8d1b-7951ad9777b5 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:41.647347 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c8530557-488f-4073-8d1b-7951ad9777b5 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:41.660315 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-73d47287-ed5e-455a-8696-ba4aa787cddb tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:41.677071 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-73d47287-ed5e-455a-8696-ba4aa787cddb tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1358 microversion: 2.1 time: 0.283297 Jul 13 21:07:41.686857 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 211/413] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:41 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1358 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:41.840540 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-d125ebe4-2095-447c-9afc-24a5fdf8926d req-c19cfe78-b1af-4644-a57b-50bb26eb9a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d43b7a85-7ba7-404c-b1f7-56e9bebc4532", "name": "network-vif-plugged", "status": "completed", "tag": "317898b2-465a-4c11-b821-ef1b8829d78f"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:07:41.852318 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-d125ebe4-2095-447c-9afc-24a5fdf8926d req-c19cfe78-b1af-4644-a57b-50bb26eb9a5c service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:41.853031 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-d125ebe4-2095-447c-9afc-24a5fdf8926d req-c19cfe78-b1af-4644-a57b-50bb26eb9a5c service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:41.867730 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-d125ebe4-2095-447c-9afc-24a5fdf8926d req-c19cfe78-b1af-4644-a57b-50bb26eb9a5c service nova] Creating event network-vif-plugged:317898b2-465a-4c11-b821-ef1b8829d78f for instance d43b7a85-7ba7-404c-b1f7-56e9bebc4532 on hv-cinder-79987 Jul 13 21:07:41.880002 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-d125ebe4-2095-447c-9afc-24a5fdf8926d req-c19cfe78-b1af-4644-a57b-50bb26eb9a5c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044735 Jul 13 21:07:41.881714 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 212/414] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:07:41.939603 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ec0e864b-c096-4ee4-8c0c-1b98564825f8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:41.940294 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ec0e864b-c096-4ee4-8c0c-1b98564825f8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:41.948200 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ec0e864b-c096-4ee4-8c0c-1b98564825f8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:41.948869 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ec0e864b-c096-4ee4-8c0c-1b98564825f8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:41.949914 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ec0e864b-c096-4ee4-8c0c-1b98564825f8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:41.950496 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ec0e864b-c096-4ee4-8c0c-1b98564825f8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:42.004422 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-c8530557-488f-4073-8d1b-7951ad9777b5 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:42.015026 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-c8530557-488f-4073-8d1b-7951ad9777b5 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1318 microversion: 2.1 time: 0.381435 Jul 13 21:07:42.025628 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 203/415] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:41 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1318 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:07:42.179780 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ec0e864b-c096-4ee4-8c0c-1b98564825f8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:42.187571 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ec0e864b-c096-4ee4-8c0c-1b98564825f8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.253560 Jul 13 21:07:42.197122 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 213/416] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:41 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:42.693318 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-eb50f108-a2f3-4f57-8999-0f38cc86d7a8 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:42.693915 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-eb50f108-a2f3-4f57-8999-0f38cc86d7a8 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:42.699858 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eb50f108-a2f3-4f57-8999-0f38cc86d7a8 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:42.700300 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eb50f108-a2f3-4f57-8999-0f38cc86d7a8 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:42.701045 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eb50f108-a2f3-4f57-8999-0f38cc86d7a8 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:42.701470 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eb50f108-a2f3-4f57-8999-0f38cc86d7a8 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:42.904598 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-eb50f108-a2f3-4f57-8999-0f38cc86d7a8 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:42.911879 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-eb50f108-a2f3-4f57-8999-0f38cc86d7a8 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1358 microversion: 2.1 time: 0.222433 Jul 13 21:07:42.912441 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 204/417] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:42 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:43.032488 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-a2793191-f460-4a03-a120-efd7cb5b4f1b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:43.033067 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-a2793191-f460-4a03-a120-efd7cb5b4f1b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:43.039523 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a2793191-f460-4a03-a120-efd7cb5b4f1b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:43.039974 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a2793191-f460-4a03-a120-efd7cb5b4f1b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:43.040729 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a2793191-f460-4a03-a120-efd7cb5b4f1b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:43.041162 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a2793191-f460-4a03-a120-efd7cb5b4f1b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:43.167922 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-a2793191-f460-4a03-a120-efd7cb5b4f1b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:43.175832 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-a2793191-f460-4a03-a120-efd7cb5b4f1b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1318 microversion: 2.1 time: 0.147321 Jul 13 21:07:43.176387 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 214/418] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:43 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:43.204430 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-f0934a84-f731-4a41-b0a7-603105710b27 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:43.205039 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-f0934a84-f731-4a41-b0a7-603105710b27 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:43.211070 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f0934a84-f731-4a41-b0a7-603105710b27 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:43.211525 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f0934a84-f731-4a41-b0a7-603105710b27 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:43.212280 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f0934a84-f731-4a41-b0a7-603105710b27 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:43.212718 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f0934a84-f731-4a41-b0a7-603105710b27 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:43.341274 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f0934a84-f731-4a41-b0a7-603105710b27 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:43.348602 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-f0934a84-f731-4a41-b0a7-603105710b27 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.148043 Jul 13 21:07:43.349163 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 205/419] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:43 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:43.928285 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-818846a3-95be-42a8-8b36-3d4a99f1caca tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:43.928842 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-818846a3-95be-42a8-8b36-3d4a99f1caca tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:43.934864 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-818846a3-95be-42a8-8b36-3d4a99f1caca tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:43.935313 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-818846a3-95be-42a8-8b36-3d4a99f1caca tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:43.936074 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-818846a3-95be-42a8-8b36-3d4a99f1caca tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:43.936509 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-818846a3-95be-42a8-8b36-3d4a99f1caca tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:43.954438 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:07:44.069787 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-818846a3-95be-42a8-8b36-3d4a99f1caca tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:44.077614 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-818846a3-95be-42a8-8b36-3d4a99f1caca tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1358 microversion: 2.1 time: 0.153370 Jul 13 21:07:44.078211 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 215/420] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:43 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:44.192530 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-4038759a-61b7-4580-8d41-43fb05e2ebcf tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:44.193152 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-4038759a-61b7-4580-8d41-43fb05e2ebcf tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:44.199424 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4038759a-61b7-4580-8d41-43fb05e2ebcf tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:44.199882 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4038759a-61b7-4580-8d41-43fb05e2ebcf tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:44.200649 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4038759a-61b7-4580-8d41-43fb05e2ebcf tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:44.201089 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4038759a-61b7-4580-8d41-43fb05e2ebcf tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:44.330711 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-4038759a-61b7-4580-8d41-43fb05e2ebcf tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:44.338342 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-4038759a-61b7-4580-8d41-43fb05e2ebcf tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1507 microversion: 2.1 time: 0.149559 Jul 13 21:07:44.338948 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 206/421] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:44 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:44.364927 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-83b32ab4-63e8-458c-b6f5-206c5ef69ff0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:44.365624 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-83b32ab4-63e8-458c-b6f5-206c5ef69ff0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:44.371831 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-83b32ab4-63e8-458c-b6f5-206c5ef69ff0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:44.372511 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-83b32ab4-63e8-458c-b6f5-206c5ef69ff0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:44.373205 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-83b32ab4-63e8-458c-b6f5-206c5ef69ff0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:44.373695 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-83b32ab4-63e8-458c-b6f5-206c5ef69ff0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:44.517077 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-83b32ab4-63e8-458c-b6f5-206c5ef69ff0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:44.526726 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-83b32ab4-63e8-458c-b6f5-206c5ef69ff0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.165485 Jul 13 21:07:44.527505 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 216/422] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:44 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:45.095551 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-57bac953-45c9-4c4e-9743-e5846f48beb5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:45.096146 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-57bac953-45c9-4c4e-9743-e5846f48beb5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:45.102106 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-57bac953-45c9-4c4e-9743-e5846f48beb5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:45.102552 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-57bac953-45c9-4c4e-9743-e5846f48beb5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:45.103358 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-57bac953-45c9-4c4e-9743-e5846f48beb5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:45.103789 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-57bac953-45c9-4c4e-9743-e5846f48beb5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:45.249459 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-57bac953-45c9-4c4e-9743-e5846f48beb5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:45.261134 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-57bac953-45c9-4c4e-9743-e5846f48beb5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1358 microversion: 2.1 time: 0.169713 Jul 13 21:07:45.261712 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 207/423] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:45 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:45.543562 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-5f8cac8f-94d1-41bd-9cd7-e6fbe3a3d59a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:45.544098 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-5f8cac8f-94d1-41bd-9cd7-e6fbe3a3d59a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:45.550559 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5f8cac8f-94d1-41bd-9cd7-e6fbe3a3d59a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:45.551027 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5f8cac8f-94d1-41bd-9cd7-e6fbe3a3d59a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:45.551777 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5f8cac8f-94d1-41bd-9cd7-e6fbe3a3d59a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:45.552206 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5f8cac8f-94d1-41bd-9cd7-e6fbe3a3d59a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:45.681224 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5f8cac8f-94d1-41bd-9cd7-e6fbe3a3d59a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:45.689239 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-5f8cac8f-94d1-41bd-9cd7-e6fbe3a3d59a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.149539 Jul 13 21:07:45.689924 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 217/424] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:45 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:45.851809 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-ef2c49e0-959d-4d59-8209-ee4550cb7a9b req-0284224b-3bcc-4ecf-891f-b73058f65674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b38afa70-d071-4833-bebb-86a20e1ee786", "name": "network-vif-plugged", "status": "completed", "tag": "0cafa13d-1a14-44df-9c31-93ee2dc5a8a0"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:07:45.859858 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-ef2c49e0-959d-4d59-8209-ee4550cb7a9b req-0284224b-3bcc-4ecf-891f-b73058f65674 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:45.860297 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-ef2c49e0-959d-4d59-8209-ee4550cb7a9b req-0284224b-3bcc-4ecf-891f-b73058f65674 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:45.871714 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-ef2c49e0-959d-4d59-8209-ee4550cb7a9b req-0284224b-3bcc-4ecf-891f-b73058f65674 service nova] Creating event network-vif-plugged:0cafa13d-1a14-44df-9c31-93ee2dc5a8a0 for instance b38afa70-d071-4833-bebb-86a20e1ee786 on hv-cinder-79987 Jul 13 21:07:45.877186 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-ef2c49e0-959d-4d59-8209-ee4550cb7a9b req-0284224b-3bcc-4ecf-891f-b73058f65674 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029006 Jul 13 21:07:45.877923 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 208/425] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:07:46.284930 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ab9fa219-0bde-4479-937a-70a83c685c9e tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:46.285525 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ab9fa219-0bde-4479-937a-70a83c685c9e tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:46.291670 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ab9fa219-0bde-4479-937a-70a83c685c9e tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:46.292106 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ab9fa219-0bde-4479-937a-70a83c685c9e tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:46.292855 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ab9fa219-0bde-4479-937a-70a83c685c9e tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:46.293281 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ab9fa219-0bde-4479-937a-70a83c685c9e tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:46.424007 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ab9fa219-0bde-4479-937a-70a83c685c9e tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:46.431549 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ab9fa219-0bde-4479-937a-70a83c685c9e tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1358 microversion: 2.1 time: 0.150505 Jul 13 21:07:46.432101 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 218/426] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:46 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:46.707168 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-efcebf24-a4a6-4c06-8d83-0cd8d14019e2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:46.707804 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-efcebf24-a4a6-4c06-8d83-0cd8d14019e2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:46.713929 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-efcebf24-a4a6-4c06-8d83-0cd8d14019e2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:46.714375 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-efcebf24-a4a6-4c06-8d83-0cd8d14019e2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:46.715161 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-efcebf24-a4a6-4c06-8d83-0cd8d14019e2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:46.715606 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-efcebf24-a4a6-4c06-8d83-0cd8d14019e2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:46.849544 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-efcebf24-a4a6-4c06-8d83-0cd8d14019e2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:46.857083 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-efcebf24-a4a6-4c06-8d83-0cd8d14019e2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.154552 Jul 13 21:07:46.857629 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 209/427] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:46 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:47.448580 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-61e8c1fc-7d95-42ed-aaea-e948c9404743 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:47.449190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-61e8c1fc-7d95-42ed-aaea-e948c9404743 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:47.456527 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-61e8c1fc-7d95-42ed-aaea-e948c9404743 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:47.456971 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-61e8c1fc-7d95-42ed-aaea-e948c9404743 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:47.457722 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-61e8c1fc-7d95-42ed-aaea-e948c9404743 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:47.458147 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-61e8c1fc-7d95-42ed-aaea-e948c9404743 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:47.586385 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-61e8c1fc-7d95-42ed-aaea-e948c9404743 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:47.593829 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-61e8c1fc-7d95-42ed-aaea-e948c9404743 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1358 microversion: 2.1 time: 0.149071 Jul 13 21:07:47.594396 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 219/428] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:47 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:47.873103 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-06bc03f7-dc58-4fa7-8a8a-f01c280dab0f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:47.873698 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-06bc03f7-dc58-4fa7-8a8a-f01c280dab0f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:47.880445 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-06bc03f7-dc58-4fa7-8a8a-f01c280dab0f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:47.880896 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-06bc03f7-dc58-4fa7-8a8a-f01c280dab0f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:47.881667 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-06bc03f7-dc58-4fa7-8a8a-f01c280dab0f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:47.882104 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-06bc03f7-dc58-4fa7-8a8a-f01c280dab0f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:47.886778 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=100 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:07:48.016895 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-06bc03f7-dc58-4fa7-8a8a-f01c280dab0f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:48.024497 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-06bc03f7-dc58-4fa7-8a8a-f01c280dab0f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.155136 Jul 13 21:07:48.025054 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 210/429] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:47 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:48.610146 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c6bb4bc8-c3c3-4488-b638-67543b8596f5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:48.610793 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-c6bb4bc8-c3c3-4488-b638-67543b8596f5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:48.617215 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c6bb4bc8-c3c3-4488-b638-67543b8596f5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:48.617662 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c6bb4bc8-c3c3-4488-b638-67543b8596f5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:48.618416 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c6bb4bc8-c3c3-4488-b638-67543b8596f5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:48.618878 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c6bb4bc8-c3c3-4488-b638-67543b8596f5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:48.747703 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c6bb4bc8-c3c3-4488-b638-67543b8596f5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:48.756166 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-c6bb4bc8-c3c3-4488-b638-67543b8596f5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1548 microversion: 2.1 time: 0.149909 Jul 13 21:07:48.756728 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 220/430] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:48 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:48.773646 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-fa39d279-10dd-4e97-baf9-a62236018636 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:48.774256 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-fa39d279-10dd-4e97-baf9-a62236018636 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:48.780232 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fa39d279-10dd-4e97-baf9-a62236018636 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:48.780684 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fa39d279-10dd-4e97-baf9-a62236018636 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:48.781444 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fa39d279-10dd-4e97-baf9-a62236018636 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:48.781882 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fa39d279-10dd-4e97-baf9-a62236018636 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:48.913969 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-fa39d279-10dd-4e97-baf9-a62236018636 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:48.923344 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-fa39d279-10dd-4e97-baf9-a62236018636 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1548 microversion: 2.1 time: 0.153630 Jul 13 21:07:48.924287 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 211/431] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:48 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:48.939285 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-d3246359-69e5-4852-b3ed-f9c7a3bf993b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:48.942843 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-d3246359-69e5-4852-b3ed-f9c7a3bf993b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:48.943594 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-d3246359-69e5-4852-b3ed-f9c7a3bf993b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Searching by: {'deleted': False, 'project_id': 'c09f02b3463a47e68081b8b47cc86985'} {{(pid=118445) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 13 21:07:48.950115 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d3246359-69e5-4852-b3ed-f9c7a3bf993b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:48.950546 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d3246359-69e5-4852-b3ed-f9c7a3bf993b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:48.951356 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d3246359-69e5-4852-b3ed-f9c7a3bf993b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:48.951783 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d3246359-69e5-4852-b3ed-f9c7a3bf993b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:49.041658 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.multi_cell_list [None req-d3246359-69e5-4852-b3ed-f9c7a3bf993b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118445) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 13 21:07:49.041984 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-401a9cd9-6ced-4e54-bde7-cb68ba786410 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:49.042606 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-401a9cd9-6ced-4e54-bde7-cb68ba786410 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:49.049184 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-401a9cd9-6ced-4e54-bde7-cb68ba786410 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:49.049637 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-401a9cd9-6ced-4e54-bde7-cb68ba786410 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:49.050399 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-401a9cd9-6ced-4e54-bde7-cb68ba786410 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:49.050868 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-401a9cd9-6ced-4e54-bde7-cb68ba786410 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:49.139647 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-d3246359-69e5-4852-b3ed-f9c7a3bf993b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204566 Jul 13 21:07:49.140244 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 221/432] 10.222.0.39 () {58 vars in 1124 bytes} [Wed Jul 13 21:07:48 2022] GET /compute/v2.1/servers => generated 343 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:07:49.150207 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-5d67f13f-7572-497e-978c-9796deaae372 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:49.150837 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-5d67f13f-7572-497e-978c-9796deaae372 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:49.156676 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5d67f13f-7572-497e-978c-9796deaae372 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:49.157122 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5d67f13f-7572-497e-978c-9796deaae372 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:49.157880 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5d67f13f-7572-497e-978c-9796deaae372 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:49.158320 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5d67f13f-7572-497e-978c-9796deaae372 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:49.185488 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-401a9cd9-6ced-4e54-bde7-cb68ba786410 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:49.193592 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-401a9cd9-6ced-4e54-bde7-cb68ba786410 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.156149 Jul 13 21:07:49.194167 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 212/433] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:49 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:07:49.289286 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5d67f13f-7572-497e-978c-9796deaae372 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:49.297339 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-5d67f13f-7572-497e-978c-9796deaae372 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1548 microversion: 2.1 time: 0.150317 Jul 13 21:07:49.297894 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 222/434] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:49 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:07:50.210394 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-59de3f9f-e108-4f11-8bff-da764b23377c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:50.211036 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-59de3f9f-e108-4f11-8bff-da764b23377c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:50.217080 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-59de3f9f-e108-4f11-8bff-da764b23377c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:50.217525 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-59de3f9f-e108-4f11-8bff-da764b23377c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:50.218333 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-59de3f9f-e108-4f11-8bff-da764b23377c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:50.218828 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-59de3f9f-e108-4f11-8bff-da764b23377c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:50.346411 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-59de3f9f-e108-4f11-8bff-da764b23377c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:50.353672 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-59de3f9f-e108-4f11-8bff-da764b23377c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.147092 Jul 13 21:07:50.354226 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 213/435] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:50 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:51.370509 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-059e8fee-1f72-425e-b90a-670e0f934c81 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:51.371146 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-059e8fee-1f72-425e-b90a-670e0f934c81 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:51.378185 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-059e8fee-1f72-425e-b90a-670e0f934c81 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:51.378640 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-059e8fee-1f72-425e-b90a-670e0f934c81 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:51.379391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-059e8fee-1f72-425e-b90a-670e0f934c81 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:51.379817 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-059e8fee-1f72-425e-b90a-670e0f934c81 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:51.506397 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-059e8fee-1f72-425e-b90a-670e0f934c81 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:51.513680 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-059e8fee-1f72-425e-b90a-670e0f934c81 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.146953 Jul 13 21:07:51.514233 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 223/436] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:51 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:51.846673 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-057d81a4-0c79-4e0a-9391-57fd3ca47d37 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea16a74d-c6fa-4b2a-91ec-8de58b83d8a0"}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:07:51.847857 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-057d81a4-0c79-4e0a-9391-57fd3ca47d37 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:51.854488 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-057d81a4-0c79-4e0a-9391-57fd3ca47d37 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:51.855258 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-057d81a4-0c79-4e0a-9391-57fd3ca47d37 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:51.856106 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-057d81a4-0c79-4e0a-9391-57fd3ca47d37 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:51.856711 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-057d81a4-0c79-4e0a-9391-57fd3ca47d37 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:52.145421 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-057d81a4-0c79-4e0a-9391-57fd3ca47d37 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "POST /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303065 Jul 13 21:07:52.146055 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 214/437] 10.222.0.39 () {60 vars in 1322 bytes} [Wed Jul 13 21:07:51 2022] POST /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:07:52.530717 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-485ac5c2-95a3-4b0b-999e-3f3626a08d24 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:52.531258 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-485ac5c2-95a3-4b0b-999e-3f3626a08d24 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:52.537662 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-485ac5c2-95a3-4b0b-999e-3f3626a08d24 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:52.538111 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-485ac5c2-95a3-4b0b-999e-3f3626a08d24 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:52.538892 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-485ac5c2-95a3-4b0b-999e-3f3626a08d24 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:52.539327 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-485ac5c2-95a3-4b0b-999e-3f3626a08d24 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:52.668308 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-485ac5c2-95a3-4b0b-999e-3f3626a08d24 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:52.675695 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-485ac5c2-95a3-4b0b-999e-3f3626a08d24 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.148834 Jul 13 21:07:52.676265 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 224/438] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:52 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:53.693533 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-32fa39ab-7e51-4ada-b26a-cfaa3a0028c4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:53.694214 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-32fa39ab-7e51-4ada-b26a-cfaa3a0028c4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:53.701077 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-32fa39ab-7e51-4ada-b26a-cfaa3a0028c4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:53.701526 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-32fa39ab-7e51-4ada-b26a-cfaa3a0028c4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:53.702281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-32fa39ab-7e51-4ada-b26a-cfaa3a0028c4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:53.702742 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-32fa39ab-7e51-4ada-b26a-cfaa3a0028c4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:53.853242 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-32fa39ab-7e51-4ada-b26a-cfaa3a0028c4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:53.861982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-32fa39ab-7e51-4ada-b26a-cfaa3a0028c4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.173113 Jul 13 21:07:53.862549 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 215/439] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:53 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:54.878882 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-f96ea873-18f4-427f-8e46-63ee2abb80f8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:54.879469 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-f96ea873-18f4-427f-8e46-63ee2abb80f8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:54.881803 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_api:SELECT=79 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:07:54.887217 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f96ea873-18f4-427f-8e46-63ee2abb80f8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:54.887659 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f96ea873-18f4-427f-8e46-63ee2abb80f8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:54.888410 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f96ea873-18f4-427f-8e46-63ee2abb80f8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:54.888842 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f96ea873-18f4-427f-8e46-63ee2abb80f8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:55.017881 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-f96ea873-18f4-427f-8e46-63ee2abb80f8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:55.025465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-f96ea873-18f4-427f-8e46-63ee2abb80f8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.150415 Jul 13 21:07:55.026029 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 225/440] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:54 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:56.042287 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b7e06673-b56d-4135-be0f-4575701bb3b3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:56.042911 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b7e06673-b56d-4135-be0f-4575701bb3b3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:56.049893 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b7e06673-b56d-4135-be0f-4575701bb3b3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:56.050446 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b7e06673-b56d-4135-be0f-4575701bb3b3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:56.051233 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b7e06673-b56d-4135-be0f-4575701bb3b3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:56.051794 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b7e06673-b56d-4135-be0f-4575701bb3b3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:56.181557 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b7e06673-b56d-4135-be0f-4575701bb3b3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:56.189837 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b7e06673-b56d-4135-be0f-4575701bb3b3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.151342 Jul 13 21:07:56.190414 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 216/441] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:56 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:57.207350 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-a7a12e76-5e3a-4475-a048-daddabaeb1ab tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:57.207982 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-a7a12e76-5e3a-4475-a048-daddabaeb1ab tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:57.214537 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a7a12e76-5e3a-4475-a048-daddabaeb1ab tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:57.215025 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a7a12e76-5e3a-4475-a048-daddabaeb1ab tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:57.215789 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a7a12e76-5e3a-4475-a048-daddabaeb1ab tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:57.216224 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a7a12e76-5e3a-4475-a048-daddabaeb1ab tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:57.350203 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-a7a12e76-5e3a-4475-a048-daddabaeb1ab tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:57.357516 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-a7a12e76-5e3a-4475-a048-daddabaeb1ab tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.154645 Jul 13 21:07:57.358092 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 226/442] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:57 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:58.374692 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-8d59948f-65ea-4c75-965d-b402cbb65b6b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:58.375291 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-8d59948f-65ea-4c75-965d-b402cbb65b6b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:58.378281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_api:SELECT=70 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:07:58.383534 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8d59948f-65ea-4c75-965d-b402cbb65b6b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:58.383979 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8d59948f-65ea-4c75-965d-b402cbb65b6b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:58.384737 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8d59948f-65ea-4c75-965d-b402cbb65b6b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:58.385167 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8d59948f-65ea-4c75-965d-b402cbb65b6b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:58.516535 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-8d59948f-65ea-4c75-965d-b402cbb65b6b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:58.524994 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-8d59948f-65ea-4c75-965d-b402cbb65b6b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.154109 Jul 13 21:07:58.525545 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 217/443] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:58 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:07:58.712474 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-7646e79e-f25e-4cc6-a5d3-5bef65d76cb2 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:58.713050 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-7646e79e-f25e-4cc6-a5d3-5bef65d76cb2 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:58.719112 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7646e79e-f25e-4cc6-a5d3-5bef65d76cb2 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:58.719556 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7646e79e-f25e-4cc6-a5d3-5bef65d76cb2 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:58.720312 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7646e79e-f25e-4cc6-a5d3-5bef65d76cb2 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:58.720748 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7646e79e-f25e-4cc6-a5d3-5bef65d76cb2 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:58.742996 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-7646e79e-f25e-4cc6-a5d3-5bef65d76cb2 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f/ips" status: 200 len: 149 microversion: 2.1 time: 0.034302 Jul 13 21:07:58.743580 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 227/444] 10.222.0.39 () {58 vars in 1247 bytes} [Wed Jul 13 21:07:58 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:07:59.541065 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-5993d94e-3a4f-43eb-b63b-239903fcbb99 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:07:59.542487 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-5993d94e-3a4f-43eb-b63b-239903fcbb99 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:07:59.548859 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5993d94e-3a4f-43eb-b63b-239903fcbb99 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:59.549314 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5993d94e-3a4f-43eb-b63b-239903fcbb99 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:59.550087 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5993d94e-3a4f-43eb-b63b-239903fcbb99 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:07:59.550524 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5993d94e-3a4f-43eb-b63b-239903fcbb99 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:07:59.690180 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-5993d94e-3a4f-43eb-b63b-239903fcbb99 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:07:59.697618 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-5993d94e-3a4f-43eb-b63b-239903fcbb99 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.160388 Jul 13 21:07:59.698166 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 218/445] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:07:59 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:00.332603 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 13 21:08:00.332757 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Wed Jul 13 21:08:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 13 21:08:00.715836 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c31bc2dd-6301-4ac6-8a05-3b0bcffd1d96 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:00.716741 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-c31bc2dd-6301-4ac6-8a05-3b0bcffd1d96 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:00.722969 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=2 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:08:00.725750 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c31bc2dd-6301-4ac6-8a05-3b0bcffd1d96 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:00.726962 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c31bc2dd-6301-4ac6-8a05-3b0bcffd1d96 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:00.727858 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c31bc2dd-6301-4ac6-8a05-3b0bcffd1d96 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:00.728510 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c31bc2dd-6301-4ac6-8a05-3b0bcffd1d96 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:00.730488 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-49dd5d70-cddc-4c7b-808f-59bc0d8dccae tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:00.731621 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-49dd5d70-cddc-4c7b-808f-59bc0d8dccae tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:00.738483 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-49dd5d70-cddc-4c7b-808f-59bc0d8dccae tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:00.739157 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-49dd5d70-cddc-4c7b-808f-59bc0d8dccae tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:00.740102 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-49dd5d70-cddc-4c7b-808f-59bc0d8dccae tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:00.740695 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-49dd5d70-cddc-4c7b-808f-59bc0d8dccae tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:00.880679 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-49dd5d70-cddc-4c7b-808f-59bc0d8dccae tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:00.890333 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-49dd5d70-cddc-4c7b-808f-59bc0d8dccae tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1594 microversion: 2.1 time: 0.164334 Jul 13 21:08:00.891753 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 219/446] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:00 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1594 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:01.056837 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c31bc2dd-6301-4ac6-8a05-3b0bcffd1d96 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:01.064331 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-c31bc2dd-6301-4ac6-8a05-3b0bcffd1d96 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.352824 Jul 13 21:08:01.064902 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 228/447] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:00 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:01.135281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-81dc4d5d-eae4-4d0e-9961-644768691f64 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83d3f6e3-7c40-4e17-ab1d-b04484673266"}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:08:01.138174 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-81dc4d5d-eae4-4d0e-9961-644768691f64 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:01.145191 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-81dc4d5d-eae4-4d0e-9961-644768691f64 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:01.145756 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-81dc4d5d-eae4-4d0e-9961-644768691f64 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:01.146597 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-81dc4d5d-eae4-4d0e-9961-644768691f64 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:01.147136 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-81dc4d5d-eae4-4d0e-9961-644768691f64 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:01.427312 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-81dc4d5d-eae4-4d0e-9961-644768691f64 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "POST /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296369 Jul 13 21:08:01.428156 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 220/448] 10.222.0.39 () {60 vars in 1322 bytes} [Wed Jul 13 21:08:01 2022] POST /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:08:02.081227 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-405d07f3-7a7d-4fdd-a963-36470d25b4ea tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:02.081854 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-405d07f3-7a7d-4fdd-a963-36470d25b4ea tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:02.088358 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-405d07f3-7a7d-4fdd-a963-36470d25b4ea tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:02.088793 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-405d07f3-7a7d-4fdd-a963-36470d25b4ea tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:02.089557 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-405d07f3-7a7d-4fdd-a963-36470d25b4ea tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:02.090008 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-405d07f3-7a7d-4fdd-a963-36470d25b4ea tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:02.220627 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-405d07f3-7a7d-4fdd-a963-36470d25b4ea tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:02.228671 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-405d07f3-7a7d-4fdd-a963-36470d25b4ea tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.151325 Jul 13 21:08:02.229392 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 229/449] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:02 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:02.645650 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-9f478250-232d-4ef8-9d6c-7106b516e7a5 req-8c8fc253-96c5-4f5a-9bdc-4a531a3f47c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b38afa70-d071-4833-bebb-86a20e1ee786", "tag": "0cafa13d-1a14-44df-9c31-93ee2dc5a8a0"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:08:02.654511 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-9f478250-232d-4ef8-9d6c-7106b516e7a5 req-8c8fc253-96c5-4f5a-9bdc-4a531a3f47c2 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:02.654989 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-9f478250-232d-4ef8-9d6c-7106b516e7a5 req-8c8fc253-96c5-4f5a-9bdc-4a531a3f47c2 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:02.668318 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-9f478250-232d-4ef8-9d6c-7106b516e7a5 req-8c8fc253-96c5-4f5a-9bdc-4a531a3f47c2 service nova] Creating event network-changed:0cafa13d-1a14-44df-9c31-93ee2dc5a8a0 for instance b38afa70-d071-4833-bebb-86a20e1ee786 on hv-cinder-79987 Jul 13 21:08:02.673705 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-9f478250-232d-4ef8-9d6c-7106b516e7a5 req-8c8fc253-96c5-4f5a-9bdc-4a531a3f47c2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032899 Jul 13 21:08:02.674592 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 221/450] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:08:03.246292 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-a86be5d8-4cf8-430f-bf27-a4557c39389e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:03.247668 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-a86be5d8-4cf8-430f-bf27-a4557c39389e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:03.254910 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a86be5d8-4cf8-430f-bf27-a4557c39389e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:03.255691 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a86be5d8-4cf8-430f-bf27-a4557c39389e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:03.256645 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a86be5d8-4cf8-430f-bf27-a4557c39389e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:03.257244 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a86be5d8-4cf8-430f-bf27-a4557c39389e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:03.449769 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-a86be5d8-4cf8-430f-bf27-a4557c39389e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:03.457993 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-a86be5d8-4cf8-430f-bf27-a4557c39389e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.215275 Jul 13 21:08:03.458909 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 230/451] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:03 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:03.863639 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-4bf2f8c8-bbf4-47e9-87a3-c3f959bcea93 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1091793762"}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:08:03.864250 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-4bf2f8c8-bbf4-47e9-87a3-c3f959bcea93 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:03.870883 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4bf2f8c8-bbf4-47e9-87a3-c3f959bcea93 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:03.871323 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4bf2f8c8-bbf4-47e9-87a3-c3f959bcea93 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:03.872100 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4bf2f8c8-bbf4-47e9-87a3-c3f959bcea93 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:03.872529 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4bf2f8c8-bbf4-47e9-87a3-c3f959bcea93 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:03.999949 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.network.security_group_api [None req-4bf2f8c8-bbf4-47e9-87a3-c3f959bcea93 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Adding security group 1d7ffe4e-809b-4bbb-ba24-169fe14761c0 to port 0cafa13d-1a14-44df-9c31-93ee2dc5a8a0 Jul 13 21:08:04.342782 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-4bf2f8c8-bbf4-47e9-87a3-c3f959bcea93 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "POST /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786/action" status: 202 len: 0 microversion: 2.1 time: 0.483726 Jul 13 21:08:04.346848 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 222/452] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Jul 13 21:08:03 2022] POST /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 13 21:08:04.352271 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-aa937801-4bf4-4b01-a2af-7277dc80f5b3 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:04.353079 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-aa937801-4bf4-4b01-a2af-7277dc80f5b3 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:04.360002 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-aa937801-4bf4-4b01-a2af-7277dc80f5b3 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:04.360598 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-aa937801-4bf4-4b01-a2af-7277dc80f5b3 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:04.361881 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-aa937801-4bf4-4b01-a2af-7277dc80f5b3 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:04.362653 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-aa937801-4bf4-4b01-a2af-7277dc80f5b3 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:04.475993 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-48a3a175-8570-4c47-a344-e8c0e6198dc4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:04.477004 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-48a3a175-8570-4c47-a344-e8c0e6198dc4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:04.483911 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-48a3a175-8570-4c47-a344-e8c0e6198dc4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:04.484667 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-48a3a175-8570-4c47-a344-e8c0e6198dc4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:04.485644 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-48a3a175-8570-4c47-a344-e8c0e6198dc4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:04.486256 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-48a3a175-8570-4c47-a344-e8c0e6198dc4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:04.535953 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-aa937801-4bf4-4b01-a2af-7277dc80f5b3 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:04.548968 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-aa937801-4bf4-4b01-a2af-7277dc80f5b3 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1760 microversion: 2.1 time: 0.200746 Jul 13 21:08:04.549767 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 231/453] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:04 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1760 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:04.630812 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-48a3a175-8570-4c47-a344-e8c0e6198dc4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:04.639577 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-48a3a175-8570-4c47-a344-e8c0e6198dc4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.167299 Jul 13 21:08:04.640433 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 223/454] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:04 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:04.691957 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-ed92fabb-d7a8-40ed-9e8d-0570442dd723 req-19f3d56e-1a16-424a-8a09-804c4b0c0e67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b38afa70-d071-4833-bebb-86a20e1ee786", "tag": "0cafa13d-1a14-44df-9c31-93ee2dc5a8a0"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:08:04.700437 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-ed92fabb-d7a8-40ed-9e8d-0570442dd723 req-19f3d56e-1a16-424a-8a09-804c4b0c0e67 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:04.701014 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-ed92fabb-d7a8-40ed-9e8d-0570442dd723 req-19f3d56e-1a16-424a-8a09-804c4b0c0e67 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:04.705535 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=100 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:08:04.714280 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-ed92fabb-d7a8-40ed-9e8d-0570442dd723 req-19f3d56e-1a16-424a-8a09-804c4b0c0e67 service nova] Creating event network-changed:0cafa13d-1a14-44df-9c31-93ee2dc5a8a0 for instance b38afa70-d071-4833-bebb-86a20e1ee786 on hv-cinder-79987 Jul 13 21:08:04.719390 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-ed92fabb-d7a8-40ed-9e8d-0570442dd723 req-19f3d56e-1a16-424a-8a09-804c4b0c0e67 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031674 Jul 13 21:08:04.720068 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 232/455] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:08:05.657817 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-1ddc51c6-f901-4c29-83f3-01ff9fa0c948 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:05.658452 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-1ddc51c6-f901-4c29-83f3-01ff9fa0c948 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:05.665532 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1ddc51c6-f901-4c29-83f3-01ff9fa0c948 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:05.665982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1ddc51c6-f901-4c29-83f3-01ff9fa0c948 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:05.666776 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1ddc51c6-f901-4c29-83f3-01ff9fa0c948 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:05.667216 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1ddc51c6-f901-4c29-83f3-01ff9fa0c948 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:05.798060 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-1ddc51c6-f901-4c29-83f3-01ff9fa0c948 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:05.805361 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-1ddc51c6-f901-4c29-83f3-01ff9fa0c948 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.151441 Jul 13 21:08:05.805912 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 224/456] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:05 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:06.822088 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-b43014c6-0b1a-4a2b-9ed7-4c1eacb92672 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:06.822818 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-b43014c6-0b1a-4a2b-9ed7-4c1eacb92672 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:06.828888 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b43014c6-0b1a-4a2b-9ed7-4c1eacb92672 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:06.829326 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b43014c6-0b1a-4a2b-9ed7-4c1eacb92672 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:06.830069 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b43014c6-0b1a-4a2b-9ed7-4c1eacb92672 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:06.830492 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b43014c6-0b1a-4a2b-9ed7-4c1eacb92672 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:06.960757 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b43014c6-0b1a-4a2b-9ed7-4c1eacb92672 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:06.968044 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-b43014c6-0b1a-4a2b-9ed7-4c1eacb92672 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.150540 Jul 13 21:08:06.968596 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 233/457] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:06 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:07.985094 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ec901dd9-9d77-4eee-bcb8-b6c86701f563 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:07.985636 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-ec901dd9-9d77-4eee-bcb8-b6c86701f563 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:07.992139 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ec901dd9-9d77-4eee-bcb8-b6c86701f563 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:07.992584 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ec901dd9-9d77-4eee-bcb8-b6c86701f563 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:07.993329 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ec901dd9-9d77-4eee-bcb8-b6c86701f563 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:07.993759 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ec901dd9-9d77-4eee-bcb8-b6c86701f563 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:07.997730 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:08:08.119793 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ec901dd9-9d77-4eee-bcb8-b6c86701f563 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:08.127650 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ec901dd9-9d77-4eee-bcb8-b6c86701f563 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.145924 Jul 13 21:08:08.128212 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 225/458] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:07 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:09.144339 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ad298a20-a19d-4def-90f2-b63748612e91 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:09.145228 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ad298a20-a19d-4def-90f2-b63748612e91 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:09.152193 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ad298a20-a19d-4def-90f2-b63748612e91 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:09.152639 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ad298a20-a19d-4def-90f2-b63748612e91 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:09.153408 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ad298a20-a19d-4def-90f2-b63748612e91 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:09.153838 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ad298a20-a19d-4def-90f2-b63748612e91 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:09.285972 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ad298a20-a19d-4def-90f2-b63748612e91 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:09.293391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ad298a20-a19d-4def-90f2-b63748612e91 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.152878 Jul 13 21:08:09.293951 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 234/459] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:09 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:09.968268 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-1823b4a4-1fdd-46e1-b594-a4bc2c576d9f tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c46bf68-8079-4f7c-8fa8-e5b3d39a4b1b", "device": "/dev/sdb"}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:08:09.969863 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-1823b4a4-1fdd-46e1-b594-a4bc2c576d9f tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:09.976988 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1823b4a4-1fdd-46e1-b594-a4bc2c576d9f tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:09.977429 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1823b4a4-1fdd-46e1-b594-a4bc2c576d9f tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:09.978213 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1823b4a4-1fdd-46e1-b594-a4bc2c576d9f tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:09.978661 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1823b4a4-1fdd-46e1-b594-a4bc2c576d9f tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:09.990449 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ca4cec79-dc17-4c71-abef-620258a3eb71 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Action: 'create', calling method: .version_select at 0x7f96e8736040>, body: {"keypair": {"name": "tempest-keypair-1784408147", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6IrS95LIB7/aY2By99oq0qqpHuXCKNIw/XDEwDpC0BTRQCmq+mkY4/UhuIJDzGQbos5pemjiLm6M9yLdhiwinF+Kp75sDl7xd3th9/HAc8v0JBa7qmwN1ixLdUTinBhA=="}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:08:10.004806 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-ca4cec79-dc17-4c71-abef-620258a3eb71 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Getting quotas for project 0a2703a8b75043e0ab0656482fa9ddeb. Resources: {'key_pairs'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:08:10.008775 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-ca4cec79-dc17-4c71-abef-620258a3eb71 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Getting quotas for user d9cab6f67cd34c46886d036ba170331e and project 0a2703a8b75043e0ab0656482fa9ddeb. Resources: {'key_pairs'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:08:10.030113 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ca4cec79-dc17-4c71-abef-620258a3eb71 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043936 Jul 13 21:08:10.030784 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 235/460] 10.222.0.39 () {60 vars in 1158 bytes} [Wed Jul 13 21:08:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:08:10.255860 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-1823b4a4-1fdd-46e1-b594-a4bc2c576d9f tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "POST /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291372 Jul 13 21:08:10.256571 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 226/461] 10.222.0.39 () {60 vars in 1322 bytes} [Wed Jul 13 21:08:09 2022] POST /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:08:10.318548 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-1e2ee9d3-7602-4d3a-820c-663c5af31b0b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:10.319891 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-1e2ee9d3-7602-4d3a-820c-663c5af31b0b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:10.327630 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1e2ee9d3-7602-4d3a-820c-663c5af31b0b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:10.328095 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1e2ee9d3-7602-4d3a-820c-663c5af31b0b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:10.329060 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1e2ee9d3-7602-4d3a-820c-663c5af31b0b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:10.329576 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1e2ee9d3-7602-4d3a-820c-663c5af31b0b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:10.523841 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-1e2ee9d3-7602-4d3a-820c-663c5af31b0b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:10.531368 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-1e2ee9d3-7602-4d3a-820c-663c5af31b0b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.224013 Jul 13 21:08:10.531936 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 236/462] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:10 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:10.617555 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-bdddc8e1-27fe-449b-9c15-b44380ec5583 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:10.618338 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-bdddc8e1-27fe-449b-9c15-b44380ec5583 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:10.625029 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bdddc8e1-27fe-449b-9c15-b44380ec5583 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:10.625574 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bdddc8e1-27fe-449b-9c15-b44380ec5583 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:10.626421 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bdddc8e1-27fe-449b-9c15-b44380ec5583 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:10.626952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bdddc8e1-27fe-449b-9c15-b44380ec5583 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:10.650237 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-bdddc8e1-27fe-449b-9c15-b44380ec5583 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f/ips" status: 200 len: 152 microversion: 2.20 time: 0.037530 Jul 13 21:08:10.650855 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 227/463] 10.222.0.39 () {60 vars in 1288 bytes} [Wed Jul 13 21:08:10 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 21:08:11.415256 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-fa1e26f7-1b32-4f30-af54-7fc9a58ac5b1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1889066399", "imageRef": "5a995c88-d784-4a51-a6b9-25aa9dfe607c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0724e09-98b0-4f74-b483-93b3266239e7"}], "security_groups": [{"name": "tempest-securitygroup--1842462729"}], "key_name": "tempest-keypair-1784408147", "user_data": "}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:08:11.513415 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.network.neutron [None req-fa1e26f7-1b32-4f30-af54-7fc9a58ac5b1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] validate_networks() for [('b0724e09-98b0-4f74-b483-93b3266239e7', None, None, None, None, None)] {{(pid=118445) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 21:08:11.549439 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b3bae23c-632d-4735-9f3e-9462173ade87 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:11.550143 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b3bae23c-632d-4735-9f3e-9462173ade87 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:11.557011 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b3bae23c-632d-4735-9f3e-9462173ade87 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:11.557457 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b3bae23c-632d-4735-9f3e-9462173ade87 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:11.558223 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b3bae23c-632d-4735-9f3e-9462173ade87 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:11.558677 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b3bae23c-632d-4735-9f3e-9462173ade87 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:11.687779 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b3bae23c-632d-4735-9f3e-9462173ade87 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:11.696991 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b3bae23c-632d-4735-9f3e-9462173ade87 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.151995 Jul 13 21:08:11.697633 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 228/464] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:11 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:11.883004 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-fa1e26f7-1b32-4f30-af54-7fc9a58ac5b1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Flavor limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 21:08:11.883428 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-fa1e26f7-1b32-4f30-af54-7fc9a58ac5b1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Image limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 21:08:11.883900 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-fa1e26f7-1b32-4f30-af54-7fc9a58ac5b1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Flavor pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 21:08:11.884354 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-fa1e26f7-1b32-4f30-af54-7fc9a58ac5b1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Image pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 21:08:11.884764 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-fa1e26f7-1b32-4f30-af54-7fc9a58ac5b1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 21:08:11.893532 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-fa1e26f7-1b32-4f30-af54-7fc9a58ac5b1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:11.893976 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-fa1e26f7-1b32-4f30-af54-7fc9a58ac5b1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:11.895062 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-fa1e26f7-1b32-4f30-af54-7fc9a58ac5b1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:11.895500 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-fa1e26f7-1b32-4f30-af54-7fc9a58ac5b1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:11.912863 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-fa1e26f7-1b32-4f30-af54-7fc9a58ac5b1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Getting quotas for project 0a2703a8b75043e0ab0656482fa9ddeb. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:08:11.916783 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-fa1e26f7-1b32-4f30-af54-7fc9a58ac5b1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Getting quotas for user d9cab6f67cd34c46886d036ba170331e and project 0a2703a8b75043e0ab0656482fa9ddeb. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:08:11.928142 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-fa1e26f7-1b32-4f30-af54-7fc9a58ac5b1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Going to run 1 instances... {{(pid=118445) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 21:08:11.930339 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-fa1e26f7-1b32-4f30-af54-7fc9a58ac5b1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995c88-d784-4a51-a6b9-25aa9dfe607c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118445) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 21:08:11.977781 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-fa1e26f7-1b32-4f30-af54-7fc9a58ac5b1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.566487 Jul 13 21:08:11.978647 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 237/465] 10.222.0.39 () {60 vars in 1146 bytes} [Wed Jul 13 21:08:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 21:08:11.988888 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-807e93d4-88f2-4ccc-8290-63c97bcbc41a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:11.999190 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-807e93d4-88f2-4ccc-8290-63c97bcbc41a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:12.046772 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-807e93d4-88f2-4ccc-8290-63c97bcbc41a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:12.054013 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-807e93d4-88f2-4ccc-8290-63c97bcbc41a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1242 microversion: 2.1 time: 0.069515 Jul 13 21:08:12.054570 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 229/466] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:11 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:12.713354 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-4fb550e5-c9bb-443d-a351-fcdba0991a0d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:12.713945 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-4fb550e5-c9bb-443d-a351-fcdba0991a0d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:12.721218 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4fb550e5-c9bb-443d-a351-fcdba0991a0d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:12.722167 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4fb550e5-c9bb-443d-a351-fcdba0991a0d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:12.722958 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4fb550e5-c9bb-443d-a351-fcdba0991a0d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:12.723394 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4fb550e5-c9bb-443d-a351-fcdba0991a0d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:12.852697 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-4fb550e5-c9bb-443d-a351-fcdba0991a0d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:12.860120 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-4fb550e5-c9bb-443d-a351-fcdba0991a0d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.150708 Jul 13 21:08:12.860678 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 238/467] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:12 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:12.927924 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-93a03a96-d05f-443d-acf9-e1f25392e49a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:08:12.928435 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-93a03a96-d05f-443d-acf9-e1f25392e49a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:12.935528 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-93a03a96-d05f-443d-acf9-e1f25392e49a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:12.935974 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-93a03a96-d05f-443d-acf9-e1f25392e49a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:12.936753 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-93a03a96-d05f-443d-acf9-e1f25392e49a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:12.937189 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-93a03a96-d05f-443d-acf9-e1f25392e49a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:12.959408 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.objects.instance [None req-93a03a96-d05f-443d-acf9-e1f25392e49a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lazy-loading 'flavor' on Instance uuid 12316d28-2975-4c1e-b05b-82a3253bb35f {{(pid=118444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:08:13.071387 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-f21e97f8-1863-450d-9f4d-c83e0f4f9e93 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:13.072017 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-f21e97f8-1863-450d-9f4d-c83e0f4f9e93 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:13.079750 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f21e97f8-1863-450d-9f4d-c83e0f4f9e93 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:13.080187 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f21e97f8-1863-450d-9f4d-c83e0f4f9e93 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:13.081428 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f21e97f8-1863-450d-9f4d-c83e0f4f9e93 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:13.081859 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f21e97f8-1863-450d-9f4d-c83e0f4f9e93 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:13.142824 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-f21e97f8-1863-450d-9f4d-c83e0f4f9e93 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:13.151193 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-f21e97f8-1863-450d-9f4d-c83e0f4f9e93 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1302 microversion: 2.1 time: 0.084038 Jul 13 21:08:13.151767 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 239/468] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:13 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1302 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:13.301100 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-93a03a96-d05f-443d-acf9-e1f25392e49a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "POST /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f/action" status: 202 len: 0 microversion: 2.20 time: 0.377444 Jul 13 21:08:13.305385 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 230/469] 10.222.0.39 () {62 vars in 1318 bytes} [Wed Jul 13 21:08:12 2022] POST /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 13 21:08:13.310665 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-347adc5f-4a34-450d-b70c-1e3b7df1ce81 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:13.311267 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-347adc5f-4a34-450d-b70c-1e3b7df1ce81 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:13.321177 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-347adc5f-4a34-450d-b70c-1e3b7df1ce81 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:13.321537 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-347adc5f-4a34-450d-b70c-1e3b7df1ce81 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:13.322297 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-347adc5f-4a34-450d-b70c-1e3b7df1ce81 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:13.322932 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-347adc5f-4a34-450d-b70c-1e3b7df1ce81 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:13.339647 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-9b16eaf1-933d-4917-b14d-7d5f9996b504 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:13.340221 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-9b16eaf1-933d-4917-b14d-7d5f9996b504 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:13.347511 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9b16eaf1-933d-4917-b14d-7d5f9996b504 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:13.347960 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9b16eaf1-933d-4917-b14d-7d5f9996b504 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:13.348739 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9b16eaf1-933d-4917-b14d-7d5f9996b504 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:13.349174 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9b16eaf1-933d-4917-b14d-7d5f9996b504 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:13.373376 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-9b16eaf1-933d-4917-b14d-7d5f9996b504 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153/ips" status: 200 len: 146 microversion: 2.1 time: 0.038229 Jul 13 21:08:13.375383 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 231/470] 10.222.0.39 () {58 vars in 1247 bytes} [Wed Jul 13 21:08:13 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:08:13.456592 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-347adc5f-4a34-450d-b70c-1e3b7df1ce81 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:13.477052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-347adc5f-4a34-450d-b70c-1e3b7df1ce81 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:13.478559 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-347adc5f-4a34-450d-b70c-1e3b7df1ce81 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:13.479750 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-347adc5f-4a34-450d-b70c-1e3b7df1ce81 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1723 microversion: 2.20 time: 0.173044 Jul 13 21:08:13.480309 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 240/471] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:13 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:13.877302 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-662ba917-6752-4aec-ae7a-1a1f85c6ce68 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:13.878477 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-662ba917-6752-4aec-ae7a-1a1f85c6ce68 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:13.884356 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-662ba917-6752-4aec-ae7a-1a1f85c6ce68 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:13.884802 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-662ba917-6752-4aec-ae7a-1a1f85c6ce68 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:13.885558 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-662ba917-6752-4aec-ae7a-1a1f85c6ce68 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:13.885999 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-662ba917-6752-4aec-ae7a-1a1f85c6ce68 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:14.088802 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-662ba917-6752-4aec-ae7a-1a1f85c6ce68 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:14.096622 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-662ba917-6752-4aec-ae7a-1a1f85c6ce68 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.223091 Jul 13 21:08:14.097231 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 232/472] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:13 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:14.169267 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-24d5ae8c-8bc4-4f91-9b73-35cf48b07a10 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:14.169891 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-24d5ae8c-8bc4-4f91-9b73-35cf48b07a10 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:14.176338 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-24d5ae8c-8bc4-4f91-9b73-35cf48b07a10 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:14.176788 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-24d5ae8c-8bc4-4f91-9b73-35cf48b07a10 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:14.177544 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-24d5ae8c-8bc4-4f91-9b73-35cf48b07a10 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:14.178001 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-24d5ae8c-8bc4-4f91-9b73-35cf48b07a10 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:14.239674 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-24d5ae8c-8bc4-4f91-9b73-35cf48b07a10 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:14.247403 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-24d5ae8c-8bc4-4f91-9b73-35cf48b07a10 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1300 microversion: 2.1 time: 0.082014 Jul 13 21:08:14.248002 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 241/473] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:14 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1300 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:14.500000 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ae5b33e4-b66b-495e-96b0-4ea688a8da86 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:14.500633 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-ae5b33e4-b66b-495e-96b0-4ea688a8da86 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:14.514432 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ae5b33e4-b66b-495e-96b0-4ea688a8da86 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:14.514911 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ae5b33e4-b66b-495e-96b0-4ea688a8da86 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:14.520529 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ae5b33e4-b66b-495e-96b0-4ea688a8da86 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:14.521175 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ae5b33e4-b66b-495e-96b0-4ea688a8da86 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:14.694124 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ae5b33e4-b66b-495e-96b0-4ea688a8da86 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:14.702901 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ae5b33e4-b66b-495e-96b0-4ea688a8da86 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:14.704633 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ae5b33e4-b66b-495e-96b0-4ea688a8da86 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:14.705998 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ae5b33e4-b66b-495e-96b0-4ea688a8da86 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1723 microversion: 2.20 time: 0.209698 Jul 13 21:08:14.706711 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 233/474] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:14 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:15.113907 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c3b8d163-ecab-4da6-89cf-9b599d157695 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:15.114505 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-c3b8d163-ecab-4da6-89cf-9b599d157695 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:15.120417 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c3b8d163-ecab-4da6-89cf-9b599d157695 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:15.120858 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c3b8d163-ecab-4da6-89cf-9b599d157695 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:15.121599 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c3b8d163-ecab-4da6-89cf-9b599d157695 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:15.122023 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c3b8d163-ecab-4da6-89cf-9b599d157695 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:15.251392 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c3b8d163-ecab-4da6-89cf-9b599d157695 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:15.258843 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-c3b8d163-ecab-4da6-89cf-9b599d157695 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.149214 Jul 13 21:08:15.259648 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 242/475] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:15 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:15.264987 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-42109bd4-ac80-4a33-8c41-73bd21dcf201 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:15.265659 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-42109bd4-ac80-4a33-8c41-73bd21dcf201 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:15.273186 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-42109bd4-ac80-4a33-8c41-73bd21dcf201 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:15.273630 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-42109bd4-ac80-4a33-8c41-73bd21dcf201 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:15.274389 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-42109bd4-ac80-4a33-8c41-73bd21dcf201 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:15.274864 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-42109bd4-ac80-4a33-8c41-73bd21dcf201 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:15.398272 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-42109bd4-ac80-4a33-8c41-73bd21dcf201 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:15.405553 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-42109bd4-ac80-4a33-8c41-73bd21dcf201 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1368 microversion: 2.1 time: 0.144446 Jul 13 21:08:15.406108 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 234/476] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:15 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1368 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:15.725171 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-31c375cf-8e66-4632-8d22-bafe5503f89e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:15.725697 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-31c375cf-8e66-4632-8d22-bafe5503f89e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:15.731577 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-31c375cf-8e66-4632-8d22-bafe5503f89e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:15.732014 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-31c375cf-8e66-4632-8d22-bafe5503f89e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:15.732756 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-31c375cf-8e66-4632-8d22-bafe5503f89e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:15.733181 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-31c375cf-8e66-4632-8d22-bafe5503f89e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:15.859028 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-31c375cf-8e66-4632-8d22-bafe5503f89e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:15.867621 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-31c375cf-8e66-4632-8d22-bafe5503f89e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:15.869116 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-31c375cf-8e66-4632-8d22-bafe5503f89e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:15.870296 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-31c375cf-8e66-4632-8d22-bafe5503f89e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1723 microversion: 2.20 time: 0.149489 Jul 13 21:08:15.870899 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 243/477] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:15 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:16.053107 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b389ccbf-e062-47cd-9945-41bc5633147a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d57d16ce-9432-4c0e-a787-907b1510e67a"}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:08:16.054229 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b389ccbf-e062-47cd-9945-41bc5633147a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:16.060246 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b389ccbf-e062-47cd-9945-41bc5633147a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:16.060698 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b389ccbf-e062-47cd-9945-41bc5633147a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:16.061455 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b389ccbf-e062-47cd-9945-41bc5633147a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:16.061892 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b389ccbf-e062-47cd-9945-41bc5633147a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:16.276017 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-f1dc2323-09e1-4275-893a-5120cdd64f3c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:16.277384 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-f1dc2323-09e1-4275-893a-5120cdd64f3c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:16.285478 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f1dc2323-09e1-4275-893a-5120cdd64f3c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:16.286004 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f1dc2323-09e1-4275-893a-5120cdd64f3c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:16.287082 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f1dc2323-09e1-4275-893a-5120cdd64f3c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:16.287587 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f1dc2323-09e1-4275-893a-5120cdd64f3c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:16.450184 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-f1dc2323-09e1-4275-893a-5120cdd64f3c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:16.459173 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-f1dc2323-09e1-4275-893a-5120cdd64f3c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.186969 Jul 13 21:08:16.459921 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 244/478] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:16 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:16.464552 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-280ece51-2de1-481a-a1ac-0515daae1ec5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:16.465322 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-280ece51-2de1-481a-a1ac-0515daae1ec5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:16.471916 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-280ece51-2de1-481a-a1ac-0515daae1ec5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:16.473096 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-280ece51-2de1-481a-a1ac-0515daae1ec5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:16.473302 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-280ece51-2de1-481a-a1ac-0515daae1ec5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:16.473803 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-280ece51-2de1-481a-a1ac-0515daae1ec5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:16.504926 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b389ccbf-e062-47cd-9945-41bc5633147a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "POST /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.455490 Jul 13 21:08:16.505892 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 235/479] 10.222.0.39 () {60 vars in 1322 bytes} [Wed Jul 13 21:08:16 2022] POST /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153/os-volume_attachments => generated 194 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:08:16.604060 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-280ece51-2de1-481a-a1ac-0515daae1ec5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:16.612505 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-280ece51-2de1-481a-a1ac-0515daae1ec5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1368 microversion: 2.1 time: 0.150773 Jul 13 21:08:16.613363 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 245/480] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:16 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:16.889386 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-fedbdad2-a24e-4ecf-a035-f5fd527c808b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:16.890253 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-fedbdad2-a24e-4ecf-a035-f5fd527c808b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:16.897363 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fedbdad2-a24e-4ecf-a035-f5fd527c808b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:16.898174 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fedbdad2-a24e-4ecf-a035-f5fd527c808b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:16.899182 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fedbdad2-a24e-4ecf-a035-f5fd527c808b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:16.899709 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fedbdad2-a24e-4ecf-a035-f5fd527c808b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:16.919161 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-9d555266-af8c-4c8a-9847-8837a0b0547e req-d9a61735-83c1-436d-8614-f132ea8b5882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a127418-a227-4cf6-a36c-822265e0b11f", "tag": "4db6331d-2b48-476c-a5bb-5ae20a91bf9d"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:08:16.931450 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-9d555266-af8c-4c8a-9847-8837a0b0547e req-d9a61735-83c1-436d-8614-f132ea8b5882 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:16.931915 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-9d555266-af8c-4c8a-9847-8837a0b0547e req-d9a61735-83c1-436d-8614-f132ea8b5882 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:16.957269 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-9d555266-af8c-4c8a-9847-8837a0b0547e req-d9a61735-83c1-436d-8614-f132ea8b5882 service nova] Creating event network-changed:4db6331d-2b48-476c-a5bb-5ae20a91bf9d for instance 8a127418-a227-4cf6-a36c-822265e0b11f on hv-cinder-79987 Jul 13 21:08:16.962799 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-9d555266-af8c-4c8a-9847-8837a0b0547e req-d9a61735-83c1-436d-8614-f132ea8b5882 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048054 Jul 13 21:08:16.963455 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 246/481] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:08:17.057763 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-fedbdad2-a24e-4ecf-a035-f5fd527c808b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:17.066231 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-fedbdad2-a24e-4ecf-a035-f5fd527c808b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:17.067754 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-fedbdad2-a24e-4ecf-a035-f5fd527c808b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:17.068901 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-fedbdad2-a24e-4ecf-a035-f5fd527c808b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1723 microversion: 2.20 time: 0.184278 Jul 13 21:08:17.069456 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 236/482] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:16 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:17.476857 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-a4172107-ed87-4827-838d-975485f0003d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:17.477545 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-a4172107-ed87-4827-838d-975485f0003d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:17.484147 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a4172107-ed87-4827-838d-975485f0003d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:17.484595 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a4172107-ed87-4827-838d-975485f0003d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:17.485340 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a4172107-ed87-4827-838d-975485f0003d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:17.485769 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a4172107-ed87-4827-838d-975485f0003d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:17.614960 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-a4172107-ed87-4827-838d-975485f0003d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:17.622383 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-a4172107-ed87-4827-838d-975485f0003d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.149712 Jul 13 21:08:17.623153 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 247/483] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:17 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:17.629668 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-694671ab-8b0d-440f-b3a9-ae54dfaafa28 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:17.630269 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-694671ab-8b0d-440f-b3a9-ae54dfaafa28 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:17.636666 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-694671ab-8b0d-440f-b3a9-ae54dfaafa28 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:17.637105 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-694671ab-8b0d-440f-b3a9-ae54dfaafa28 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:17.637904 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-694671ab-8b0d-440f-b3a9-ae54dfaafa28 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:17.638337 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-694671ab-8b0d-440f-b3a9-ae54dfaafa28 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:17.767377 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-694671ab-8b0d-440f-b3a9-ae54dfaafa28 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:17.774968 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-694671ab-8b0d-440f-b3a9-ae54dfaafa28 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1368 microversion: 2.1 time: 0.149708 Jul 13 21:08:17.775532 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 237/484] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:17 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:18.086823 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-6644876b-9307-4773-8278-55f04fda4c70 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:18.087344 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-6644876b-9307-4773-8278-55f04fda4c70 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:18.093418 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6644876b-9307-4773-8278-55f04fda4c70 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:18.095028 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6644876b-9307-4773-8278-55f04fda4c70 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:18.095028 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6644876b-9307-4773-8278-55f04fda4c70 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:18.095207 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6644876b-9307-4773-8278-55f04fda4c70 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:18.219567 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-6644876b-9307-4773-8278-55f04fda4c70 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:18.227419 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-6644876b-9307-4773-8278-55f04fda4c70 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:18.228900 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-6644876b-9307-4773-8278-55f04fda4c70 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:18.230030 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-6644876b-9307-4773-8278-55f04fda4c70 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1723 microversion: 2.20 time: 0.147249 Jul 13 21:08:18.230579 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 248/485] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:18 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:18.639973 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0f98f237-5907-45f9-ab11-03d4966c864e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:18.640510 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-0f98f237-5907-45f9-ab11-03d4966c864e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:18.647848 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0f98f237-5907-45f9-ab11-03d4966c864e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:18.648290 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0f98f237-5907-45f9-ab11-03d4966c864e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:18.649043 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0f98f237-5907-45f9-ab11-03d4966c864e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:18.649478 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0f98f237-5907-45f9-ab11-03d4966c864e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:18.783321 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-0f98f237-5907-45f9-ab11-03d4966c864e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:18.789514 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:08:18.790891 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-81d159de-cdd8-48dd-89af-67184f6d2e5c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:18.791934 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-81d159de-cdd8-48dd-89af-67184f6d2e5c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:18.794919 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-0f98f237-5907-45f9-ab11-03d4966c864e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1521 microversion: 2.1 time: 0.158720 Jul 13 21:08:18.795576 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 238/486] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:18 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:18.799141 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-81d159de-cdd8-48dd-89af-67184f6d2e5c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:18.800171 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-81d159de-cdd8-48dd-89af-67184f6d2e5c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:18.801055 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-81d159de-cdd8-48dd-89af-67184f6d2e5c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:18.801503 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-81d159de-cdd8-48dd-89af-67184f6d2e5c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:18.926823 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-81d159de-cdd8-48dd-89af-67184f6d2e5c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:18.934069 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-81d159de-cdd8-48dd-89af-67184f6d2e5c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1368 microversion: 2.1 time: 0.147352 Jul 13 21:08:18.934675 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 249/487] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:18 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:19.248250 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-5a386197-51f8-4522-9848-b1869975922f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:19.248845 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-5a386197-51f8-4522-9848-b1869975922f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:19.256678 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5a386197-51f8-4522-9848-b1869975922f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:19.256678 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5a386197-51f8-4522-9848-b1869975922f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:19.257443 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5a386197-51f8-4522-9848-b1869975922f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:19.257900 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5a386197-51f8-4522-9848-b1869975922f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:19.386470 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-5a386197-51f8-4522-9848-b1869975922f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:19.394513 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-5a386197-51f8-4522-9848-b1869975922f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:19.396025 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-5a386197-51f8-4522-9848-b1869975922f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:19.397186 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-5a386197-51f8-4522-9848-b1869975922f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1723 microversion: 2.20 time: 0.152782 Jul 13 21:08:19.397742 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 239/488] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:19 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:19.812347 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-fe619fb7-f6d8-4fd2-80f7-9f0947a461c8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:19.812944 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-fe619fb7-f6d8-4fd2-80f7-9f0947a461c8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:19.819372 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-fe619fb7-f6d8-4fd2-80f7-9f0947a461c8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:19.819811 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-fe619fb7-f6d8-4fd2-80f7-9f0947a461c8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:19.820565 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-fe619fb7-f6d8-4fd2-80f7-9f0947a461c8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:19.821122 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-fe619fb7-f6d8-4fd2-80f7-9f0947a461c8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:19.951365 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b264435f-5c0e-4e19-892d-e3d875f76ecd tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:19.952091 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b264435f-5c0e-4e19-892d-e3d875f76ecd tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:19.963237 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b264435f-5c0e-4e19-892d-e3d875f76ecd tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:19.964267 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b264435f-5c0e-4e19-892d-e3d875f76ecd tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:19.965785 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b264435f-5c0e-4e19-892d-e3d875f76ecd tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:19.966858 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b264435f-5c0e-4e19-892d-e3d875f76ecd tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:20.018190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-fe619fb7-f6d8-4fd2-80f7-9f0947a461c8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:20.027573 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-fe619fb7-f6d8-4fd2-80f7-9f0947a461c8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1501 microversion: 2.1 time: 0.218984 Jul 13 21:08:20.028482 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 250/489] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:19 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1501 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:20.043988 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-70fb558b-1403-4776-b7bc-90b386532de6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:20.044668 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-70fb558b-1403-4776-b7bc-90b386532de6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:20.051525 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-70fb558b-1403-4776-b7bc-90b386532de6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:20.051968 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-70fb558b-1403-4776-b7bc-90b386532de6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:20.052713 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-70fb558b-1403-4776-b7bc-90b386532de6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:20.053187 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-70fb558b-1403-4776-b7bc-90b386532de6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:20.204339 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-70fb558b-1403-4776-b7bc-90b386532de6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:20.208702 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=100 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:08:20.214981 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-70fb558b-1403-4776-b7bc-90b386532de6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1516 microversion: 2.1 time: 0.174722 Jul 13 21:08:20.216334 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 251/490] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:20 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:20.227785 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b264435f-5c0e-4e19-892d-e3d875f76ecd tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:20.235669 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b264435f-5c0e-4e19-892d-e3d875f76ecd tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1368 microversion: 2.1 time: 0.288765 Jul 13 21:08:20.236228 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 240/491] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:19 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1368 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:20.415845 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ac58fea0-6507-4198-8608-ad7bc5b7fb3f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:20.416439 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ac58fea0-6507-4198-8608-ad7bc5b7fb3f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:20.423099 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ac58fea0-6507-4198-8608-ad7bc5b7fb3f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:20.423556 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ac58fea0-6507-4198-8608-ad7bc5b7fb3f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:20.424902 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ac58fea0-6507-4198-8608-ad7bc5b7fb3f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:20.425338 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ac58fea0-6507-4198-8608-ad7bc5b7fb3f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:20.580868 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ac58fea0-6507-4198-8608-ad7bc5b7fb3f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:20.588798 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ac58fea0-6507-4198-8608-ad7bc5b7fb3f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:20.590290 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ac58fea0-6507-4198-8608-ad7bc5b7fb3f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:20.591467 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ac58fea0-6507-4198-8608-ad7bc5b7fb3f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1723 microversion: 2.20 time: 0.179790 Jul 13 21:08:20.592019 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 252/492] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:20 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:21.253338 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b56d992e-ae2a-4021-98a6-6c2ee71bee96 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:21.253937 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b56d992e-ae2a-4021-98a6-6c2ee71bee96 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:21.260340 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b56d992e-ae2a-4021-98a6-6c2ee71bee96 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:21.260787 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b56d992e-ae2a-4021-98a6-6c2ee71bee96 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:21.261538 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b56d992e-ae2a-4021-98a6-6c2ee71bee96 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:21.261973 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b56d992e-ae2a-4021-98a6-6c2ee71bee96 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:21.387218 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b56d992e-ae2a-4021-98a6-6c2ee71bee96 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:21.395230 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b56d992e-ae2a-4021-98a6-6c2ee71bee96 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1368 microversion: 2.1 time: 0.146199 Jul 13 21:08:21.395788 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 241/493] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:21 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:21.610218 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-34ba6aec-08d0-47a9-997c-6ab7a3721407 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:21.610866 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-34ba6aec-08d0-47a9-997c-6ab7a3721407 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:21.617216 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-34ba6aec-08d0-47a9-997c-6ab7a3721407 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:21.617655 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-34ba6aec-08d0-47a9-997c-6ab7a3721407 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:21.618402 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-34ba6aec-08d0-47a9-997c-6ab7a3721407 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:21.618890 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-34ba6aec-08d0-47a9-997c-6ab7a3721407 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:21.744109 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-34ba6aec-08d0-47a9-997c-6ab7a3721407 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:21.752179 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-34ba6aec-08d0-47a9-997c-6ab7a3721407 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:21.753660 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-34ba6aec-08d0-47a9-997c-6ab7a3721407 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:21.754826 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-34ba6aec-08d0-47a9-997c-6ab7a3721407 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1723 microversion: 2.20 time: 0.148397 Jul 13 21:08:21.755372 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 253/494] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:21 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:22.412580 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-d7ad75f6-2ba1-4337-ae52-ac277862bbee tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:22.413186 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-d7ad75f6-2ba1-4337-ae52-ac277862bbee tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:22.415079 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell0:SELECT=2 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:08:22.420488 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d7ad75f6-2ba1-4337-ae52-ac277862bbee tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:22.420936 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d7ad75f6-2ba1-4337-ae52-ac277862bbee tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:22.421688 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d7ad75f6-2ba1-4337-ae52-ac277862bbee tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:22.422120 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d7ad75f6-2ba1-4337-ae52-ac277862bbee tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:22.551459 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-d7ad75f6-2ba1-4337-ae52-ac277862bbee tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:22.558735 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-d7ad75f6-2ba1-4337-ae52-ac277862bbee tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1368 microversion: 2.1 time: 0.150561 Jul 13 21:08:22.559298 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 242/495] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:22 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:22.773698 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-b0d2eb35-26d4-4c0b-82de-dad5c3d3dde1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:22.774221 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-b0d2eb35-26d4-4c0b-82de-dad5c3d3dde1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:22.776055 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=2 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:08:22.776694 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=10 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:08:22.783286 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b0d2eb35-26d4-4c0b-82de-dad5c3d3dde1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:22.783724 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b0d2eb35-26d4-4c0b-82de-dad5c3d3dde1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:22.785148 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b0d2eb35-26d4-4c0b-82de-dad5c3d3dde1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:22.785573 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b0d2eb35-26d4-4c0b-82de-dad5c3d3dde1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:22.911069 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b0d2eb35-26d4-4c0b-82de-dad5c3d3dde1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:22.918750 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b0d2eb35-26d4-4c0b-82de-dad5c3d3dde1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:22.920215 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b0d2eb35-26d4-4c0b-82de-dad5c3d3dde1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:22.921336 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-b0d2eb35-26d4-4c0b-82de-dad5c3d3dde1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1723 microversion: 2.20 time: 0.151533 Jul 13 21:08:22.921885 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 254/496] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:22 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:23.574980 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-a40ece5e-a605-434f-8559-8ffdf9814cb0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:23.575585 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-a40ece5e-a605-434f-8559-8ffdf9814cb0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:23.582455 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a40ece5e-a605-434f-8559-8ffdf9814cb0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:23.582929 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a40ece5e-a605-434f-8559-8ffdf9814cb0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:23.583681 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a40ece5e-a605-434f-8559-8ffdf9814cb0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:23.584112 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a40ece5e-a605-434f-8559-8ffdf9814cb0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:23.711942 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-a40ece5e-a605-434f-8559-8ffdf9814cb0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:23.719186 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-a40ece5e-a605-434f-8559-8ffdf9814cb0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1368 microversion: 2.1 time: 0.147937 Jul 13 21:08:23.719741 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 243/497] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:23 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:23.939016 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-560ab27e-e6b9-4bd4-8abc-ab832e2bf60e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:23.939620 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-560ab27e-e6b9-4bd4-8abc-ab832e2bf60e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:23.946738 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-560ab27e-e6b9-4bd4-8abc-ab832e2bf60e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:23.947187 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-560ab27e-e6b9-4bd4-8abc-ab832e2bf60e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:23.947947 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-560ab27e-e6b9-4bd4-8abc-ab832e2bf60e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:23.948381 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-560ab27e-e6b9-4bd4-8abc-ab832e2bf60e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:24.074821 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-560ab27e-e6b9-4bd4-8abc-ab832e2bf60e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:24.082575 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-560ab27e-e6b9-4bd4-8abc-ab832e2bf60e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:24.084100 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-560ab27e-e6b9-4bd4-8abc-ab832e2bf60e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:24.085271 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-560ab27e-e6b9-4bd4-8abc-ab832e2bf60e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1723 microversion: 2.20 time: 0.149990 Jul 13 21:08:24.085819 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 255/498] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:23 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:24.735242 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-32d9f025-fb1c-4c9f-af53-8aa171df2e64 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:24.735835 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-32d9f025-fb1c-4c9f-af53-8aa171df2e64 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:24.742747 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-32d9f025-fb1c-4c9f-af53-8aa171df2e64 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:24.743190 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-32d9f025-fb1c-4c9f-af53-8aa171df2e64 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:24.744053 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-32d9f025-fb1c-4c9f-af53-8aa171df2e64 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:24.744569 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-32d9f025-fb1c-4c9f-af53-8aa171df2e64 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:24.871827 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-32d9f025-fb1c-4c9f-af53-8aa171df2e64 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:24.880048 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-32d9f025-fb1c-4c9f-af53-8aa171df2e64 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1368 microversion: 2.1 time: 0.148495 Jul 13 21:08:24.880609 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 244/499] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:24 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:25.103727 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ee1f2110-f3bb-4e8f-a006-01a73d91e435 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:25.104327 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ee1f2110-f3bb-4e8f-a006-01a73d91e435 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:25.106810 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:08:25.112644 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ee1f2110-f3bb-4e8f-a006-01a73d91e435 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:25.113080 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ee1f2110-f3bb-4e8f-a006-01a73d91e435 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:25.113829 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ee1f2110-f3bb-4e8f-a006-01a73d91e435 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:25.114254 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ee1f2110-f3bb-4e8f-a006-01a73d91e435 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:25.240508 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ee1f2110-f3bb-4e8f-a006-01a73d91e435 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:25.248292 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ee1f2110-f3bb-4e8f-a006-01a73d91e435 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:25.249762 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ee1f2110-f3bb-4e8f-a006-01a73d91e435 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:25.250916 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ee1f2110-f3bb-4e8f-a006-01a73d91e435 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1723 microversion: 2.20 time: 0.150898 Jul 13 21:08:25.251468 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 256/500] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:25 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:25.897298 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-d0068cc7-4b1f-48a9-be41-c35578a1612b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:25.897895 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-d0068cc7-4b1f-48a9-be41-c35578a1612b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:25.904269 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d0068cc7-4b1f-48a9-be41-c35578a1612b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:25.904716 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d0068cc7-4b1f-48a9-be41-c35578a1612b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:25.905459 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d0068cc7-4b1f-48a9-be41-c35578a1612b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:25.905894 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d0068cc7-4b1f-48a9-be41-c35578a1612b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:26.038665 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-d0068cc7-4b1f-48a9-be41-c35578a1612b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:26.046030 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-d0068cc7-4b1f-48a9-be41-c35578a1612b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1368 microversion: 2.1 time: 0.153357 Jul 13 21:08:26.046581 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 245/501] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:25 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:26.269730 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-0bf393a6-d24d-4a19-8bb7-e1986eaa9e07 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:26.270453 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-0bf393a6-d24d-4a19-8bb7-e1986eaa9e07 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:26.277932 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0bf393a6-d24d-4a19-8bb7-e1986eaa9e07 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:26.279126 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0bf393a6-d24d-4a19-8bb7-e1986eaa9e07 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:26.280203 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0bf393a6-d24d-4a19-8bb7-e1986eaa9e07 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:26.280731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0bf393a6-d24d-4a19-8bb7-e1986eaa9e07 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:26.422404 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-0bf393a6-d24d-4a19-8bb7-e1986eaa9e07 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:26.432497 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-0bf393a6-d24d-4a19-8bb7-e1986eaa9e07 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:26.434133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-0bf393a6-d24d-4a19-8bb7-e1986eaa9e07 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:26.435494 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-0bf393a6-d24d-4a19-8bb7-e1986eaa9e07 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1723 microversion: 2.20 time: 0.170015 Jul 13 21:08:26.436057 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 257/502] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:26 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:26.832500 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-d5bf1285-ae8d-4ce3-b343-4d1a5b0249b7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:08:26.833526 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-d5bf1285-ae8d-4ce3-b343-4d1a5b0249b7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:26.839543 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d5bf1285-ae8d-4ce3-b343-4d1a5b0249b7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:26.839986 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d5bf1285-ae8d-4ce3-b343-4d1a5b0249b7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:26.840732 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d5bf1285-ae8d-4ce3-b343-4d1a5b0249b7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:26.841161 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d5bf1285-ae8d-4ce3-b343-4d1a5b0249b7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:26.862337 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.objects.instance [None req-d5bf1285-ae8d-4ce3-b343-4d1a5b0249b7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lazy-loading 'flavor' on Instance uuid b0f6b2e3-dfe2-417f-a343-d2d9b990df70 {{(pid=118444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:08:26.931135 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-d5bf1285-ae8d-4ce3-b343-4d1a5b0249b7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "POST /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70/action" status: 200 len: 32 microversion: 2.1 time: 0.103105 Jul 13 21:08:26.931819 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 246/503] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Jul 13 21:08:26 2022] POST /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70/action => generated 32 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 13 21:08:26.941070 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-67d30584-8427-4902-bdb7-0068d95f1f4e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:26.941664 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-67d30584-8427-4902-bdb7-0068d95f1f4e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:26.947572 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-67d30584-8427-4902-bdb7-0068d95f1f4e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:26.948009 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-67d30584-8427-4902-bdb7-0068d95f1f4e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:26.948749 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-67d30584-8427-4902-bdb7-0068d95f1f4e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:26.949173 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-67d30584-8427-4902-bdb7-0068d95f1f4e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:27.063028 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-02de4783-f254-4d73-83d7-04083221400f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:27.063740 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-02de4783-f254-4d73-83d7-04083221400f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:27.070652 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-02de4783-f254-4d73-83d7-04083221400f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:27.071111 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-02de4783-f254-4d73-83d7-04083221400f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:27.071891 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-02de4783-f254-4d73-83d7-04083221400f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:27.074971 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-67d30584-8427-4902-bdb7-0068d95f1f4e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:27.075156 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-02de4783-f254-4d73-83d7-04083221400f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:27.083146 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-67d30584-8427-4902-bdb7-0068d95f1f4e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1522 microversion: 2.1 time: 0.146342 Jul 13 21:08:27.083708 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 258/504] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:26 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:27.205631 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-02de4783-f254-4d73-83d7-04083221400f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:27.213035 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-02de4783-f254-4d73-83d7-04083221400f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1368 microversion: 2.1 time: 0.154317 Jul 13 21:08:27.213604 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 247/505] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:27 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:27.454124 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-478ea4b7-6f10-49f5-8ceb-4bcdb07daa40 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:27.454785 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-478ea4b7-6f10-49f5-8ceb-4bcdb07daa40 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:27.461281 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-478ea4b7-6f10-49f5-8ceb-4bcdb07daa40 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:27.461724 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-478ea4b7-6f10-49f5-8ceb-4bcdb07daa40 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:27.462477 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-478ea4b7-6f10-49f5-8ceb-4bcdb07daa40 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:27.462928 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-478ea4b7-6f10-49f5-8ceb-4bcdb07daa40 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:27.593603 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-478ea4b7-6f10-49f5-8ceb-4bcdb07daa40 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:27.601981 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-478ea4b7-6f10-49f5-8ceb-4bcdb07daa40 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:27.603532 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-478ea4b7-6f10-49f5-8ceb-4bcdb07daa40 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:27.604681 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-478ea4b7-6f10-49f5-8ceb-4bcdb07daa40 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1723 microversion: 2.20 time: 0.154415 Jul 13 21:08:27.605235 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 259/506] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:27 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:28.101098 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-bb94d526-27b9-499b-a938-bd578169ea89 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:28.101701 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-bb94d526-27b9-499b-a938-bd578169ea89 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:28.108339 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bb94d526-27b9-499b-a938-bd578169ea89 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:28.108789 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bb94d526-27b9-499b-a938-bd578169ea89 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:28.109550 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bb94d526-27b9-499b-a938-bd578169ea89 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:28.109987 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bb94d526-27b9-499b-a938-bd578169ea89 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:28.229394 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c53db2a7-50f0-435d-b68d-9c450299f6e6 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:28.229998 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-c53db2a7-50f0-435d-b68d-9c450299f6e6 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:28.236158 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c53db2a7-50f0-435d-b68d-9c450299f6e6 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:28.236605 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c53db2a7-50f0-435d-b68d-9c450299f6e6 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:28.237866 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c53db2a7-50f0-435d-b68d-9c450299f6e6 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:28.238298 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c53db2a7-50f0-435d-b68d-9c450299f6e6 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:28.243977 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-bb94d526-27b9-499b-a938-bd578169ea89 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:28.251254 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-bb94d526-27b9-499b-a938-bd578169ea89 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1522 microversion: 2.1 time: 0.153936 Jul 13 21:08:28.251850 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 248/507] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:28 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:28.362839 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c53db2a7-50f0-435d-b68d-9c450299f6e6 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:28.370179 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-c53db2a7-50f0-435d-b68d-9c450299f6e6 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1368 microversion: 2.1 time: 0.144751 Jul 13 21:08:28.370763 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 260/508] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:28 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1368 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:28.622843 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-92ba8d5c-2ecc-4681-9b04-0ff3e32d294d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:28.623494 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-92ba8d5c-2ecc-4681-9b04-0ff3e32d294d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:28.625399 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_api:SELECT=66 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:08:28.630931 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-92ba8d5c-2ecc-4681-9b04-0ff3e32d294d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:28.631372 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-92ba8d5c-2ecc-4681-9b04-0ff3e32d294d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:28.632118 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-92ba8d5c-2ecc-4681-9b04-0ff3e32d294d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:28.632548 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-92ba8d5c-2ecc-4681-9b04-0ff3e32d294d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:28.760900 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-92ba8d5c-2ecc-4681-9b04-0ff3e32d294d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:28.768705 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-92ba8d5c-2ecc-4681-9b04-0ff3e32d294d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:28.770427 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-92ba8d5c-2ecc-4681-9b04-0ff3e32d294d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:28.771653 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-92ba8d5c-2ecc-4681-9b04-0ff3e32d294d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1723 microversion: 2.20 time: 0.152736 Jul 13 21:08:28.772196 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 249/509] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:28 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:29.268776 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-bf6049b5-dcbc-44db-a4fb-12c73e72be06 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:29.269688 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-bf6049b5-dcbc-44db-a4fb-12c73e72be06 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:29.276181 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bf6049b5-dcbc-44db-a4fb-12c73e72be06 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:29.276621 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bf6049b5-dcbc-44db-a4fb-12c73e72be06 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:29.277376 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bf6049b5-dcbc-44db-a4fb-12c73e72be06 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:29.277960 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bf6049b5-dcbc-44db-a4fb-12c73e72be06 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:29.387043 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0cbc78ea-87b8-40c9-99f5-4f7ea8916c86 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:29.387881 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-0cbc78ea-87b8-40c9-99f5-4f7ea8916c86 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:29.394516 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0cbc78ea-87b8-40c9-99f5-4f7ea8916c86 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:29.395108 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0cbc78ea-87b8-40c9-99f5-4f7ea8916c86 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:29.395756 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0cbc78ea-87b8-40c9-99f5-4f7ea8916c86 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:29.396191 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0cbc78ea-87b8-40c9-99f5-4f7ea8916c86 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:29.401640 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-bf6049b5-dcbc-44db-a4fb-12c73e72be06 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:29.409777 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-bf6049b5-dcbc-44db-a4fb-12c73e72be06 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1522 microversion: 2.1 time: 0.144822 Jul 13 21:08:29.410337 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 261/510] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:29 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:29.524137 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-0cbc78ea-87b8-40c9-99f5-4f7ea8916c86 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:29.531508 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-0cbc78ea-87b8-40c9-99f5-4f7ea8916c86 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1368 microversion: 2.1 time: 0.148218 Jul 13 21:08:29.532066 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 250/511] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:29 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:29.790136 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-4b5f2044-65f7-492a-9a1c-a70b3303c5be tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:29.790680 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-4b5f2044-65f7-492a-9a1c-a70b3303c5be tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:29.796641 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4b5f2044-65f7-492a-9a1c-a70b3303c5be tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:29.797083 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4b5f2044-65f7-492a-9a1c-a70b3303c5be tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:29.798584 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4b5f2044-65f7-492a-9a1c-a70b3303c5be tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:29.799052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4b5f2044-65f7-492a-9a1c-a70b3303c5be tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:29.926043 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-4b5f2044-65f7-492a-9a1c-a70b3303c5be tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:29.933874 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-4b5f2044-65f7-492a-9a1c-a70b3303c5be tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:29.935390 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-4b5f2044-65f7-492a-9a1c-a70b3303c5be tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:29.936521 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-4b5f2044-65f7-492a-9a1c-a70b3303c5be tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1723 microversion: 2.20 time: 0.150361 Jul 13 21:08:29.937078 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 262/512] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:29 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:30.426518 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-df0d82c8-4af9-45d8-b3b3-4388e94e74bd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:30.427152 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-df0d82c8-4af9-45d8-b3b3-4388e94e74bd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:30.433623 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-df0d82c8-4af9-45d8-b3b3-4388e94e74bd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:30.434070 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-df0d82c8-4af9-45d8-b3b3-4388e94e74bd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:30.434857 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-df0d82c8-4af9-45d8-b3b3-4388e94e74bd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:30.435294 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-df0d82c8-4af9-45d8-b3b3-4388e94e74bd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:30.548799 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-a5ff0b11-bb20-4858-bdae-c2d7b897e221 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:30.549524 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-a5ff0b11-bb20-4858-bdae-c2d7b897e221 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:30.556515 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a5ff0b11-bb20-4858-bdae-c2d7b897e221 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:30.556957 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a5ff0b11-bb20-4858-bdae-c2d7b897e221 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:30.557713 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a5ff0b11-bb20-4858-bdae-c2d7b897e221 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:30.558143 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a5ff0b11-bb20-4858-bdae-c2d7b897e221 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:30.565050 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-df0d82c8-4af9-45d8-b3b3-4388e94e74bd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:30.572323 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-df0d82c8-4af9-45d8-b3b3-4388e94e74bd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1522 microversion: 2.1 time: 0.150103 Jul 13 21:08:30.572884 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 251/513] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:30 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:30.684065 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-a5ff0b11-bb20-4858-bdae-c2d7b897e221 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:30.691318 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-a5ff0b11-bb20-4858-bdae-c2d7b897e221 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1368 microversion: 2.1 time: 0.146409 Jul 13 21:08:30.691867 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 263/514] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:30 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:30.955064 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-e5297a7a-389b-4543-8ba9-df38002af73d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:30.955682 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-e5297a7a-389b-4543-8ba9-df38002af73d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:30.962156 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e5297a7a-389b-4543-8ba9-df38002af73d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:30.962607 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e5297a7a-389b-4543-8ba9-df38002af73d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:30.963474 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e5297a7a-389b-4543-8ba9-df38002af73d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:30.963933 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e5297a7a-389b-4543-8ba9-df38002af73d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:31.095566 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-e5297a7a-389b-4543-8ba9-df38002af73d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:31.104204 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-e5297a7a-389b-4543-8ba9-df38002af73d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:31.105677 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-e5297a7a-389b-4543-8ba9-df38002af73d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:31.106845 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-e5297a7a-389b-4543-8ba9-df38002af73d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1723 microversion: 2.20 time: 0.155635 Jul 13 21:08:31.107400 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 252/515] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:30 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:31.589170 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-1216c910-3185-4a4e-9df7-feb00f7198b0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:31.589694 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-1216c910-3185-4a4e-9df7-feb00f7198b0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:31.596140 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1216c910-3185-4a4e-9df7-feb00f7198b0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:31.596587 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1216c910-3185-4a4e-9df7-feb00f7198b0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:31.597353 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1216c910-3185-4a4e-9df7-feb00f7198b0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:31.597787 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1216c910-3185-4a4e-9df7-feb00f7198b0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:31.707845 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-5aad7f3e-0106-477f-8d5c-f820f26e6b91 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:31.708571 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-5aad7f3e-0106-477f-8d5c-f820f26e6b91 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:31.715089 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5aad7f3e-0106-477f-8d5c-f820f26e6b91 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:31.715632 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5aad7f3e-0106-477f-8d5c-f820f26e6b91 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:31.716458 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5aad7f3e-0106-477f-8d5c-f820f26e6b91 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:31.717003 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5aad7f3e-0106-477f-8d5c-f820f26e6b91 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:31.732427 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-1216c910-3185-4a4e-9df7-feb00f7198b0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:31.735030 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:08:31.740691 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-1216c910-3185-4a4e-9df7-feb00f7198b0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1522 microversion: 2.1 time: 0.155428 Jul 13 21:08:31.741258 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 264/516] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:31 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:31.847436 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-5aad7f3e-0106-477f-8d5c-f820f26e6b91 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:31.854698 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-5aad7f3e-0106-477f-8d5c-f820f26e6b91 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1368 microversion: 2.1 time: 0.150624 Jul 13 21:08:31.855253 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 253/517] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:31 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:32.125399 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-2c81edc7-9c21-4e4a-a584-0538282290e9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:32.126028 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-2c81edc7-9c21-4e4a-a584-0538282290e9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:32.132034 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2c81edc7-9c21-4e4a-a584-0538282290e9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:32.132475 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2c81edc7-9c21-4e4a-a584-0538282290e9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:32.133224 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2c81edc7-9c21-4e4a-a584-0538282290e9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:32.133682 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2c81edc7-9c21-4e4a-a584-0538282290e9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:32.260751 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-2c81edc7-9c21-4e4a-a584-0538282290e9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:32.268985 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-2c81edc7-9c21-4e4a-a584-0538282290e9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:32.270528 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-2c81edc7-9c21-4e4a-a584-0538282290e9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:32.271713 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-2c81edc7-9c21-4e4a-a584-0538282290e9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1723 microversion: 2.20 time: 0.150186 Jul 13 21:08:32.272266 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 265/518] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:32 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:32.759852 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-daec4d26-ce4d-4571-a2a8-ee08775e132a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:32.760453 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-daec4d26-ce4d-4571-a2a8-ee08775e132a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:32.768079 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-daec4d26-ce4d-4571-a2a8-ee08775e132a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:32.769313 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-daec4d26-ce4d-4571-a2a8-ee08775e132a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:32.770087 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-daec4d26-ce4d-4571-a2a8-ee08775e132a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:32.770549 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-daec4d26-ce4d-4571-a2a8-ee08775e132a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:32.871492 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-3dedda9d-e557-4924-b397-86473a950dfb tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:32.872108 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-3dedda9d-e557-4924-b397-86473a950dfb tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:32.879233 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3dedda9d-e557-4924-b397-86473a950dfb tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:32.879699 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3dedda9d-e557-4924-b397-86473a950dfb tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:32.880449 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3dedda9d-e557-4924-b397-86473a950dfb tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:32.880881 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3dedda9d-e557-4924-b397-86473a950dfb tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:32.990157 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-daec4d26-ce4d-4571-a2a8-ee08775e132a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:32.998052 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-daec4d26-ce4d-4571-a2a8-ee08775e132a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1522 microversion: 2.1 time: 0.243415 Jul 13 21:08:32.998823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 254/519] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:32 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:33.018021 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3dedda9d-e557-4924-b397-86473a950dfb tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:33.026201 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-3dedda9d-e557-4924-b397-86473a950dfb tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1368 microversion: 2.1 time: 0.158459 Jul 13 21:08:33.026816 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 266/520] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:32 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:33.289118 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b449e1a9-a2f8-4ebc-817e-ecf552f64831 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:33.289710 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b449e1a9-a2f8-4ebc-817e-ecf552f64831 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:33.295946 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b449e1a9-a2f8-4ebc-817e-ecf552f64831 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:33.296395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b449e1a9-a2f8-4ebc-817e-ecf552f64831 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:33.297155 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b449e1a9-a2f8-4ebc-817e-ecf552f64831 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:33.297607 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b449e1a9-a2f8-4ebc-817e-ecf552f64831 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:33.427792 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b449e1a9-a2f8-4ebc-817e-ecf552f64831 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:33.435560 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b449e1a9-a2f8-4ebc-817e-ecf552f64831 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:33.437039 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b449e1a9-a2f8-4ebc-817e-ecf552f64831 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:33.438216 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b449e1a9-a2f8-4ebc-817e-ecf552f64831 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1723 microversion: 2.20 time: 0.152941 Jul 13 21:08:33.438793 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 255/521] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:33 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:34.015428 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-07b23803-b1f3-40c8-a781-271b2eefd629 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:34.016033 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-07b23803-b1f3-40c8-a781-271b2eefd629 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:34.023234 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-07b23803-b1f3-40c8-a781-271b2eefd629 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:34.023683 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-07b23803-b1f3-40c8-a781-271b2eefd629 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:34.024439 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-07b23803-b1f3-40c8-a781-271b2eefd629 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:34.024881 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-07b23803-b1f3-40c8-a781-271b2eefd629 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:34.042934 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b4ac2939-d5f2-46db-9833-ebb12f43850e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:34.043542 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b4ac2939-d5f2-46db-9833-ebb12f43850e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:34.049912 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b4ac2939-d5f2-46db-9833-ebb12f43850e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:34.050356 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b4ac2939-d5f2-46db-9833-ebb12f43850e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:34.051154 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b4ac2939-d5f2-46db-9833-ebb12f43850e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:34.051586 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b4ac2939-d5f2-46db-9833-ebb12f43850e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:34.155540 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-07b23803-b1f3-40c8-a781-271b2eefd629 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:34.163590 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-07b23803-b1f3-40c8-a781-271b2eefd629 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1522 microversion: 2.1 time: 0.152234 Jul 13 21:08:34.164154 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 267/522] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:34 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:34.180515 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b4ac2939-d5f2-46db-9833-ebb12f43850e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:34.187890 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b4ac2939-d5f2-46db-9833-ebb12f43850e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1368 microversion: 2.1 time: 0.148702 Jul 13 21:08:34.188456 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 256/523] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:34 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:34.457414 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-a8f2a564-0230-4948-845a-cf078ad59955 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:34.458012 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-a8f2a564-0230-4948-845a-cf078ad59955 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:34.463943 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a8f2a564-0230-4948-845a-cf078ad59955 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:34.464385 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a8f2a564-0230-4948-845a-cf078ad59955 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:34.465135 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a8f2a564-0230-4948-845a-cf078ad59955 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:34.465563 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a8f2a564-0230-4948-845a-cf078ad59955 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:34.482568 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=100 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:08:34.589401 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-a8f2a564-0230-4948-845a-cf078ad59955 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:34.597126 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-a8f2a564-0230-4948-845a-cf078ad59955 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:34.598595 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-a8f2a564-0230-4948-845a-cf078ad59955 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:34.599773 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-a8f2a564-0230-4948-845a-cf078ad59955 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1723 microversion: 2.20 time: 0.146731 Jul 13 21:08:34.600317 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 268/524] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:34 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:35.180690 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-c4b2ee47-c646-4882-a72d-1cc5e12bafa7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:35.181276 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-c4b2ee47-c646-4882-a72d-1cc5e12bafa7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:35.187702 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c4b2ee47-c646-4882-a72d-1cc5e12bafa7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:35.188154 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c4b2ee47-c646-4882-a72d-1cc5e12bafa7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:35.188915 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c4b2ee47-c646-4882-a72d-1cc5e12bafa7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:35.189356 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c4b2ee47-c646-4882-a72d-1cc5e12bafa7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:35.204423 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-63561f92-906e-460d-a37b-a5b6382ade6f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:35.205695 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-63561f92-906e-460d-a37b-a5b6382ade6f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:35.212650 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-63561f92-906e-460d-a37b-a5b6382ade6f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:35.213087 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-63561f92-906e-460d-a37b-a5b6382ade6f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:35.213841 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-63561f92-906e-460d-a37b-a5b6382ade6f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:35.214268 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-63561f92-906e-460d-a37b-a5b6382ade6f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:35.319769 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-c4b2ee47-c646-4882-a72d-1cc5e12bafa7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:35.327352 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-c4b2ee47-c646-4882-a72d-1cc5e12bafa7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1522 microversion: 2.1 time: 0.150614 Jul 13 21:08:35.327920 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 257/525] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:35 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:35.345557 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-63561f92-906e-460d-a37b-a5b6382ade6f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:35.353829 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-63561f92-906e-460d-a37b-a5b6382ade6f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1368 microversion: 2.1 time: 0.153152 Jul 13 21:08:35.354382 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 269/526] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:35 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:35.616991 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-162749cf-d6da-404d-9f90-6ae9d31c0b89 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:35.617591 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-162749cf-d6da-404d-9f90-6ae9d31c0b89 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:35.623501 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-162749cf-d6da-404d-9f90-6ae9d31c0b89 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:35.623969 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-162749cf-d6da-404d-9f90-6ae9d31c0b89 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:35.624706 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-162749cf-d6da-404d-9f90-6ae9d31c0b89 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:35.625141 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-162749cf-d6da-404d-9f90-6ae9d31c0b89 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:35.753068 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-162749cf-d6da-404d-9f90-6ae9d31c0b89 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:35.760817 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-162749cf-d6da-404d-9f90-6ae9d31c0b89 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:35.762307 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-162749cf-d6da-404d-9f90-6ae9d31c0b89 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:35.763493 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-162749cf-d6da-404d-9f90-6ae9d31c0b89 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1723 microversion: 2.20 time: 0.150285 Jul 13 21:08:35.764030 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 258/527] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:35 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:36.344030 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-bb4f6c2f-59c8-4861-8ef5-ec32fe89e97c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:36.344667 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-bb4f6c2f-59c8-4861-8ef5-ec32fe89e97c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:36.351231 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bb4f6c2f-59c8-4861-8ef5-ec32fe89e97c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:36.351679 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bb4f6c2f-59c8-4861-8ef5-ec32fe89e97c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:36.352440 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bb4f6c2f-59c8-4861-8ef5-ec32fe89e97c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:36.352876 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bb4f6c2f-59c8-4861-8ef5-ec32fe89e97c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:36.380402 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ab42eaf5-a34f-469a-87e6-aeea6d131614 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:36.381358 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-ab42eaf5-a34f-469a-87e6-aeea6d131614 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:36.387566 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ab42eaf5-a34f-469a-87e6-aeea6d131614 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:36.388014 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ab42eaf5-a34f-469a-87e6-aeea6d131614 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:36.388775 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ab42eaf5-a34f-469a-87e6-aeea6d131614 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:36.389214 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ab42eaf5-a34f-469a-87e6-aeea6d131614 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:36.481804 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-bb4f6c2f-59c8-4861-8ef5-ec32fe89e97c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:36.489757 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-bb4f6c2f-59c8-4861-8ef5-ec32fe89e97c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1522 microversion: 2.1 time: 0.149515 Jul 13 21:08:36.490318 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 270/528] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:36 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:36.515181 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ab42eaf5-a34f-469a-87e6-aeea6d131614 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:36.523027 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ab42eaf5-a34f-469a-87e6-aeea6d131614 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1368 microversion: 2.1 time: 0.155718 Jul 13 21:08:36.523666 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 259/529] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:36 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:36.782364 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-92a70534-d83d-4ac3-b74c-1c717d0f5d1f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:36.782996 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-92a70534-d83d-4ac3-b74c-1c717d0f5d1f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:36.789473 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-92a70534-d83d-4ac3-b74c-1c717d0f5d1f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:36.789918 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-92a70534-d83d-4ac3-b74c-1c717d0f5d1f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:36.790701 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-92a70534-d83d-4ac3-b74c-1c717d0f5d1f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:36.791138 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-92a70534-d83d-4ac3-b74c-1c717d0f5d1f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:36.926411 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-92a70534-d83d-4ac3-b74c-1c717d0f5d1f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:36.934557 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-92a70534-d83d-4ac3-b74c-1c717d0f5d1f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:36.936089 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-92a70534-d83d-4ac3-b74c-1c717d0f5d1f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:36.937244 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-92a70534-d83d-4ac3-b74c-1c717d0f5d1f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1723 microversion: 2.20 time: 0.158804 Jul 13 21:08:36.937924 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 271/530] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:36 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:37.507287 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-e3f016ac-f213-465f-9546-9411451a1e43 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:37.507886 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-e3f016ac-f213-465f-9546-9411451a1e43 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:37.514249 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e3f016ac-f213-465f-9546-9411451a1e43 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:37.514782 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e3f016ac-f213-465f-9546-9411451a1e43 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:37.515489 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e3f016ac-f213-465f-9546-9411451a1e43 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:37.515924 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e3f016ac-f213-465f-9546-9411451a1e43 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:37.539502 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-0e79afaa-c9cb-48a2-9c2f-b6ef681ca40b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:37.540098 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-0e79afaa-c9cb-48a2-9c2f-b6ef681ca40b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:37.546749 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0e79afaa-c9cb-48a2-9c2f-b6ef681ca40b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:37.547202 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0e79afaa-c9cb-48a2-9c2f-b6ef681ca40b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:37.547974 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0e79afaa-c9cb-48a2-9c2f-b6ef681ca40b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:37.548410 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0e79afaa-c9cb-48a2-9c2f-b6ef681ca40b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:37.650799 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-e3f016ac-f213-465f-9546-9411451a1e43 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:37.658497 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-e3f016ac-f213-465f-9546-9411451a1e43 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1522 microversion: 2.1 time: 0.155556 Jul 13 21:08:37.659342 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 260/531] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:37 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:37.681946 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-0e79afaa-c9cb-48a2-9c2f-b6ef681ca40b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:37.689310 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-0e79afaa-c9cb-48a2-9c2f-b6ef681ca40b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1368 microversion: 2.1 time: 0.153536 Jul 13 21:08:37.689861 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 272/532] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:37 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:37.955494 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-e5109c49-6281-4375-990d-fecd4a0a226f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:37.956321 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-e5109c49-6281-4375-990d-fecd4a0a226f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:37.962482 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e5109c49-6281-4375-990d-fecd4a0a226f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:37.963138 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e5109c49-6281-4375-990d-fecd4a0a226f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:37.963936 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e5109c49-6281-4375-990d-fecd4a0a226f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:37.964380 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e5109c49-6281-4375-990d-fecd4a0a226f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:38.017199 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-136d5754-4891-4d34-8641-662481dc449b req-eb82f8af-3165-4267-bcb4-e0e34213d6b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a127418-a227-4cf6-a36c-822265e0b11f", "name": "network-vif-plugged", "status": "completed", "tag": "4db6331d-2b48-476c-a5bb-5ae20a91bf9d"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:08:38.026796 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-136d5754-4891-4d34-8641-662481dc449b req-eb82f8af-3165-4267-bcb4-e0e34213d6b2 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:38.027219 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-136d5754-4891-4d34-8641-662481dc449b req-eb82f8af-3165-4267-bcb4-e0e34213d6b2 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:38.039487 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-136d5754-4891-4d34-8641-662481dc449b req-eb82f8af-3165-4267-bcb4-e0e34213d6b2 service nova] Creating event network-vif-plugged:4db6331d-2b48-476c-a5bb-5ae20a91bf9d for instance 8a127418-a227-4cf6-a36c-822265e0b11f on hv-cinder-79987 Jul 13 21:08:38.044709 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-136d5754-4891-4d34-8641-662481dc449b req-eb82f8af-3165-4267-bcb4-e0e34213d6b2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031298 Jul 13 21:08:38.045619 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 273/533] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:08:38.098139 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-e5109c49-6281-4375-990d-fecd4a0a226f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:38.105908 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-e5109c49-6281-4375-990d-fecd4a0a226f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:38.107433 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-e5109c49-6281-4375-990d-fecd4a0a226f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:38.108575 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-e5109c49-6281-4375-990d-fecd4a0a226f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1723 microversion: 2.20 time: 0.156917 Jul 13 21:08:38.109126 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 261/534] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:37 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:38.676926 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c719e196-c0b4-4ea6-ab4c-9560dfb0cd44 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:38.677873 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-c719e196-c0b4-4ea6-ab4c-9560dfb0cd44 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:38.684298 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c719e196-c0b4-4ea6-ab4c-9560dfb0cd44 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:38.684745 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c719e196-c0b4-4ea6-ab4c-9560dfb0cd44 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:38.686027 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c719e196-c0b4-4ea6-ab4c-9560dfb0cd44 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:38.686469 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c719e196-c0b4-4ea6-ab4c-9560dfb0cd44 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:38.707235 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-fb0c0744-41eb-41c0-b29d-d198d0b67f61 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:38.707840 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-fb0c0744-41eb-41c0-b29d-d198d0b67f61 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:38.714539 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fb0c0744-41eb-41c0-b29d-d198d0b67f61 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:38.715050 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fb0c0744-41eb-41c0-b29d-d198d0b67f61 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:38.715814 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fb0c0744-41eb-41c0-b29d-d198d0b67f61 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:38.716256 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fb0c0744-41eb-41c0-b29d-d198d0b67f61 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:38.820328 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c719e196-c0b4-4ea6-ab4c-9560dfb0cd44 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:38.827841 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-c719e196-c0b4-4ea6-ab4c-9560dfb0cd44 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1522 microversion: 2.1 time: 0.155928 Jul 13 21:08:38.828392 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 274/535] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:38 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:38.849998 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-fb0c0744-41eb-41c0-b29d-d198d0b67f61 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:38.857332 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-fb0c0744-41eb-41c0-b29d-d198d0b67f61 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1368 microversion: 2.1 time: 0.154424 Jul 13 21:08:38.857891 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 262/536] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:38 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:39.127175 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-d19d5ff4-1900-4a93-a4c1-9e63652d9a7c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:39.127767 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-d19d5ff4-1900-4a93-a4c1-9e63652d9a7c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:39.134086 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d19d5ff4-1900-4a93-a4c1-9e63652d9a7c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:39.134519 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d19d5ff4-1900-4a93-a4c1-9e63652d9a7c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:39.135305 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d19d5ff4-1900-4a93-a4c1-9e63652d9a7c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:39.135760 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d19d5ff4-1900-4a93-a4c1-9e63652d9a7c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:39.263030 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-d19d5ff4-1900-4a93-a4c1-9e63652d9a7c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:39.271742 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-d19d5ff4-1900-4a93-a4c1-9e63652d9a7c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:39.273214 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-d19d5ff4-1900-4a93-a4c1-9e63652d9a7c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:39.274378 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-d19d5ff4-1900-4a93-a4c1-9e63652d9a7c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1723 microversion: 2.20 time: 0.150977 Jul 13 21:08:39.275410 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 275/537] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:39 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:39.845088 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ce70e317-c6d0-42e5-ab05-b35898b34a53 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:39.845692 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-ce70e317-c6d0-42e5-ab05-b35898b34a53 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:39.852637 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ce70e317-c6d0-42e5-ab05-b35898b34a53 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:39.853088 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ce70e317-c6d0-42e5-ab05-b35898b34a53 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:39.853843 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ce70e317-c6d0-42e5-ab05-b35898b34a53 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:39.854281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ce70e317-c6d0-42e5-ab05-b35898b34a53 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:39.873046 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-49d4d0a6-a251-4168-b963-631b02518719 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:39.873652 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-49d4d0a6-a251-4168-b963-631b02518719 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:39.880066 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-49d4d0a6-a251-4168-b963-631b02518719 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:39.880518 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-49d4d0a6-a251-4168-b963-631b02518719 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:39.881275 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-49d4d0a6-a251-4168-b963-631b02518719 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:39.881706 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-49d4d0a6-a251-4168-b963-631b02518719 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:39.983412 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ce70e317-c6d0-42e5-ab05-b35898b34a53 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:39.990800 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ce70e317-c6d0-42e5-ab05-b35898b34a53 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1522 microversion: 2.1 time: 0.149449 Jul 13 21:08:39.991371 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 263/538] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:39 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:40.009422 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-49d4d0a6-a251-4168-b963-631b02518719 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:40.016711 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-49d4d0a6-a251-4168-b963-631b02518719 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1368 microversion: 2.1 time: 0.147439 Jul 13 21:08:40.017274 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 276/539] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:39 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:40.293387 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-716bb9eb-6391-4583-91cf-e7229cd5db99 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:40.293983 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-716bb9eb-6391-4583-91cf-e7229cd5db99 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:40.299940 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-716bb9eb-6391-4583-91cf-e7229cd5db99 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:40.300387 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-716bb9eb-6391-4583-91cf-e7229cd5db99 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:40.301186 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-716bb9eb-6391-4583-91cf-e7229cd5db99 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:40.301662 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-716bb9eb-6391-4583-91cf-e7229cd5db99 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:40.435921 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-716bb9eb-6391-4583-91cf-e7229cd5db99 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:40.444422 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-716bb9eb-6391-4583-91cf-e7229cd5db99 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:40.445928 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-716bb9eb-6391-4583-91cf-e7229cd5db99 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:40.447082 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-716bb9eb-6391-4583-91cf-e7229cd5db99 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1723 microversion: 2.20 time: 0.157708 Jul 13 21:08:40.447636 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 264/540] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:40 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:41.008628 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-5a47003a-11f1-4ec1-b568-33701e33a27f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:41.009184 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-5a47003a-11f1-4ec1-b568-33701e33a27f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:41.015609 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5a47003a-11f1-4ec1-b568-33701e33a27f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:41.016088 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5a47003a-11f1-4ec1-b568-33701e33a27f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:41.016847 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5a47003a-11f1-4ec1-b568-33701e33a27f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:41.017281 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5a47003a-11f1-4ec1-b568-33701e33a27f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:41.033915 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-cf2ff321-4cff-49e6-968c-2ba3d4a4275a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:41.035037 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-cf2ff321-4cff-49e6-968c-2ba3d4a4275a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:41.041440 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-cf2ff321-4cff-49e6-968c-2ba3d4a4275a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:41.041890 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-cf2ff321-4cff-49e6-968c-2ba3d4a4275a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:41.042687 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-cf2ff321-4cff-49e6-968c-2ba3d4a4275a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:41.043128 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-cf2ff321-4cff-49e6-968c-2ba3d4a4275a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:41.151312 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5a47003a-11f1-4ec1-b568-33701e33a27f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:41.158722 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-5a47003a-11f1-4ec1-b568-33701e33a27f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1522 microversion: 2.1 time: 0.154019 Jul 13 21:08:41.159848 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 277/541] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:41 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:41.177557 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-cf2ff321-4cff-49e6-968c-2ba3d4a4275a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:41.185064 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-cf2ff321-4cff-49e6-968c-2ba3d4a4275a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1368 microversion: 2.1 time: 0.154965 Jul 13 21:08:41.185617 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 265/542] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:41 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:41.465175 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-698a5c76-00ec-48e1-be09-d358081f7a6b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:41.465795 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-698a5c76-00ec-48e1-be09-d358081f7a6b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:41.472406 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-698a5c76-00ec-48e1-be09-d358081f7a6b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:41.472845 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-698a5c76-00ec-48e1-be09-d358081f7a6b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:41.473586 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-698a5c76-00ec-48e1-be09-d358081f7a6b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:41.474008 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-698a5c76-00ec-48e1-be09-d358081f7a6b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:41.598157 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-698a5c76-00ec-48e1-be09-d358081f7a6b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:41.605855 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-698a5c76-00ec-48e1-be09-d358081f7a6b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:41.607410 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-698a5c76-00ec-48e1-be09-d358081f7a6b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:41.608509 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-698a5c76-00ec-48e1-be09-d358081f7a6b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1744 microversion: 2.20 time: 0.147258 Jul 13 21:08:41.609062 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 278/543] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:41 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1744 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:41.904622 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0c9deabd-dab7-4369-a5f9-ff53d7f969bf tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:08:41.910687 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0c9deabd-dab7-4369-a5f9-ff53d7f969bf tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:41.911140 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0c9deabd-dab7-4369-a5f9-ff53d7f969bf tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:41.969613 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-0c9deabd-dab7-4369-a5f9-ff53d7f969bf tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Going to try to stop instance {{(pid=118444) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 13 21:08:42.012723 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-0c9deabd-dab7-4369-a5f9-ff53d7f969bf tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "POST /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153/action" status: 202 len: 0 microversion: 2.1 time: 0.111696 Jul 13 21:08:42.013317 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 266/544] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Jul 13 21:08:41 2022] POST /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 21:08:42.022395 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ef9de2ea-d4cc-4717-aea9-293974217478 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:42.023027 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ef9de2ea-d4cc-4717-aea9-293974217478 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:42.029517 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ef9de2ea-d4cc-4717-aea9-293974217478 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:42.030028 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ef9de2ea-d4cc-4717-aea9-293974217478 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:42.030837 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ef9de2ea-d4cc-4717-aea9-293974217478 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:42.031638 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ef9de2ea-d4cc-4717-aea9-293974217478 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:42.159158 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ef9de2ea-d4cc-4717-aea9-293974217478 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:42.166926 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ef9de2ea-d4cc-4717-aea9-293974217478 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1723 microversion: 2.1 time: 0.149368 Jul 13 21:08:42.167489 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 279/545] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:42 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:42.177235 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-d1f9b97b-bbbb-4fae-bcad-328719dd856a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:42.178063 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-d1f9b97b-bbbb-4fae-bcad-328719dd856a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:42.184651 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d1f9b97b-bbbb-4fae-bcad-328719dd856a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:42.185091 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d1f9b97b-bbbb-4fae-bcad-328719dd856a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:42.185842 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d1f9b97b-bbbb-4fae-bcad-328719dd856a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:42.186278 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d1f9b97b-bbbb-4fae-bcad-328719dd856a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:42.200983 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-f920ce14-19e5-46d9-953f-ff4c32a82e72 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:42.201585 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-f920ce14-19e5-46d9-953f-ff4c32a82e72 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:42.207583 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f920ce14-19e5-46d9-953f-ff4c32a82e72 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:42.208031 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f920ce14-19e5-46d9-953f-ff4c32a82e72 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:42.208781 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f920ce14-19e5-46d9-953f-ff4c32a82e72 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:42.209211 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f920ce14-19e5-46d9-953f-ff4c32a82e72 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:42.322549 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-d1f9b97b-bbbb-4fae-bcad-328719dd856a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:42.330029 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-d1f9b97b-bbbb-4fae-bcad-328719dd856a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1522 microversion: 2.1 time: 0.157390 Jul 13 21:08:42.330601 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 267/546] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:42 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:42.335183 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b320693d-dcd7-4724-94ec-f20e0aee4395 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:42.335676 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b320693d-dcd7-4724-94ec-f20e0aee4395 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:42.341387 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b320693d-dcd7-4724-94ec-f20e0aee4395 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:42.341932 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b320693d-dcd7-4724-94ec-f20e0aee4395 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:42.342786 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b320693d-dcd7-4724-94ec-f20e0aee4395 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:42.343292 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b320693d-dcd7-4724-94ec-f20e0aee4395 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:42.345538 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-f920ce14-19e5-46d9-953f-ff4c32a82e72 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:42.353648 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-f920ce14-19e5-46d9-953f-ff4c32a82e72 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1368 microversion: 2.1 time: 0.156429 Jul 13 21:08:42.354394 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 280/547] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:42 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:42.473778 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.objects.instance [None req-b320693d-dcd7-4724-94ec-f20e0aee4395 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lazy-loading 'services' on Instance uuid d43b7a85-7ba7-404c-b1f7-56e9bebc4532 {{(pid=118444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:08:42.507961 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:08:42.602340 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b320693d-dcd7-4724-94ec-f20e0aee4395 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532/os-volume_attachments/4c46bf68-8079-4f7c-8fa8-e5b3d39a4b1b" status: 202 len: 0 microversion: 2.1 time: 0.270496 Jul 13 21:08:42.602963 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 268/548] 10.222.0.39 () {58 vars in 1415 bytes} [Wed Jul 13 21:08:42 2022] DELETE /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532/os-volume_attachments/4c46bf68-8079-4f7c-8fa8-e5b3d39a4b1b => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 21:08:42.627108 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c63d7e8b-287d-42e4-ab0b-15c50bbd0522 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:42.627736 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-c63d7e8b-287d-42e4-ab0b-15c50bbd0522 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:42.633707 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c63d7e8b-287d-42e4-ab0b-15c50bbd0522 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:42.634146 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c63d7e8b-287d-42e4-ab0b-15c50bbd0522 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:42.634963 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c63d7e8b-287d-42e4-ab0b-15c50bbd0522 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:42.635393 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c63d7e8b-287d-42e4-ab0b-15c50bbd0522 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:42.766523 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c63d7e8b-287d-42e4-ab0b-15c50bbd0522 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:42.774521 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c63d7e8b-287d-42e4-ab0b-15c50bbd0522 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:42.776035 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c63d7e8b-287d-42e4-ab0b-15c50bbd0522 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:42.777169 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-c63d7e8b-287d-42e4-ab0b-15c50bbd0522 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1744 microversion: 2.20 time: 0.153905 Jul 13 21:08:42.777725 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 281/549] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:42 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:43.185120 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b5494411-9600-4a8c-ab36-2027559a693b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:43.185802 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b5494411-9600-4a8c-ab36-2027559a693b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:43.192813 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b5494411-9600-4a8c-ab36-2027559a693b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:43.193262 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b5494411-9600-4a8c-ab36-2027559a693b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:43.194040 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b5494411-9600-4a8c-ab36-2027559a693b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:43.194504 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b5494411-9600-4a8c-ab36-2027559a693b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:43.323337 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b5494411-9600-4a8c-ab36-2027559a693b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:43.331807 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b5494411-9600-4a8c-ab36-2027559a693b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1723 microversion: 2.1 time: 0.150185 Jul 13 21:08:43.332367 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 269/550] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:43 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:43.346833 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-78a0d898-92ac-4aa2-9c30-54406a8ece97 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:43.347439 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-78a0d898-92ac-4aa2-9c30-54406a8ece97 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:43.354006 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-78a0d898-92ac-4aa2-9c30-54406a8ece97 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:43.354456 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-78a0d898-92ac-4aa2-9c30-54406a8ece97 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:43.355265 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-78a0d898-92ac-4aa2-9c30-54406a8ece97 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:43.355700 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-78a0d898-92ac-4aa2-9c30-54406a8ece97 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:43.370658 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-a46ddeb4-db4a-4441-8e20-4e496778ce39 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:43.371279 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-a46ddeb4-db4a-4441-8e20-4e496778ce39 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:43.377100 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a46ddeb4-db4a-4441-8e20-4e496778ce39 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:43.377548 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a46ddeb4-db4a-4441-8e20-4e496778ce39 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:43.378834 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a46ddeb4-db4a-4441-8e20-4e496778ce39 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:43.379267 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a46ddeb4-db4a-4441-8e20-4e496778ce39 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:43.485937 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-78a0d898-92ac-4aa2-9c30-54406a8ece97 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:43.494171 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-78a0d898-92ac-4aa2-9c30-54406a8ece97 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1522 microversion: 2.1 time: 0.151112 Jul 13 21:08:43.494687 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 282/551] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:43 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:43.506882 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-a46ddeb4-db4a-4441-8e20-4e496778ce39 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:43.514260 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-a46ddeb4-db4a-4441-8e20-4e496778ce39 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1368 microversion: 2.1 time: 0.147276 Jul 13 21:08:43.514848 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 270/552] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:43 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:43.797165 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-e83dcf98-e090-4c5c-96cc-ed995ace77e8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:43.797784 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-e83dcf98-e090-4c5c-96cc-ed995ace77e8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:43.804250 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e83dcf98-e090-4c5c-96cc-ed995ace77e8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:43.804704 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e83dcf98-e090-4c5c-96cc-ed995ace77e8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:43.805449 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e83dcf98-e090-4c5c-96cc-ed995ace77e8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:43.805878 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e83dcf98-e090-4c5c-96cc-ed995ace77e8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:43.929542 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-e83dcf98-e090-4c5c-96cc-ed995ace77e8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:43.937527 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-e83dcf98-e090-4c5c-96cc-ed995ace77e8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:43.939056 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-e83dcf98-e090-4c5c-96cc-ed995ace77e8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:43.940200 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-e83dcf98-e090-4c5c-96cc-ed995ace77e8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1744 microversion: 2.20 time: 0.148065 Jul 13 21:08:43.940757 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 283/553] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:43 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1744 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:44.348495 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-49d92221-2ceb-40d6-aa3c-fdd7856a6244 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:44.349086 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-49d92221-2ceb-40d6-aa3c-fdd7856a6244 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:44.355716 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-49d92221-2ceb-40d6-aa3c-fdd7856a6244 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:44.356164 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-49d92221-2ceb-40d6-aa3c-fdd7856a6244 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:44.357619 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-49d92221-2ceb-40d6-aa3c-fdd7856a6244 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:44.358073 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-49d92221-2ceb-40d6-aa3c-fdd7856a6244 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:44.491768 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-49d92221-2ceb-40d6-aa3c-fdd7856a6244 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:44.500042 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-49d92221-2ceb-40d6-aa3c-fdd7856a6244 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1723 microversion: 2.1 time: 0.155370 Jul 13 21:08:44.500641 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 271/554] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:44 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:44.511609 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-412846b4-d629-49fe-9eba-797e4d33b2e0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:44.512290 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-412846b4-d629-49fe-9eba-797e4d33b2e0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:44.520458 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-412846b4-d629-49fe-9eba-797e4d33b2e0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:44.520733 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-09f7006c-8886-4217-995e-4d0823f25375 req-1d8671a3-5def-49ca-9116-74d7f885cdfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12316d28-2975-4c1e-b05b-82a3253bb35f", "name": "network-vif-plugged", "status": "completed", "tag": "8d927002-4a46-4df8-b48a-c6cb84decd8d"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:08:44.520898 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-412846b4-d629-49fe-9eba-797e4d33b2e0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:44.521663 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-412846b4-d629-49fe-9eba-797e4d33b2e0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:44.522092 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-412846b4-d629-49fe-9eba-797e4d33b2e0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:44.529476 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-09f7006c-8886-4217-995e-4d0823f25375 req-1d8671a3-5def-49ca-9116-74d7f885cdfd service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:44.529932 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-09f7006c-8886-4217-995e-4d0823f25375 req-1d8671a3-5def-49ca-9116-74d7f885cdfd service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:44.543147 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-09f7006c-8886-4217-995e-4d0823f25375 req-1d8671a3-5def-49ca-9116-74d7f885cdfd service nova] Creating event network-vif-plugged:8d927002-4a46-4df8-b48a-c6cb84decd8d for instance 12316d28-2975-4c1e-b05b-82a3253bb35f on hv-cinder-79987 Jul 13 21:08:44.548362 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-09f7006c-8886-4217-995e-4d0823f25375 req-1d8671a3-5def-49ca-9116-74d7f885cdfd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031350 Jul 13 21:08:44.549444 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 272/555] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:08:44.554995 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-2b08337a-76f2-4f80-8d16-1f71286dd877 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:44.555836 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-2b08337a-76f2-4f80-8d16-1f71286dd877 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:44.562495 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2b08337a-76f2-4f80-8d16-1f71286dd877 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:44.562972 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2b08337a-76f2-4f80-8d16-1f71286dd877 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:44.563820 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2b08337a-76f2-4f80-8d16-1f71286dd877 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:44.564204 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2b08337a-76f2-4f80-8d16-1f71286dd877 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:44.679654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-412846b4-d629-49fe-9eba-797e4d33b2e0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:44.687352 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-412846b4-d629-49fe-9eba-797e4d33b2e0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1522 microversion: 2.1 time: 0.179555 Jul 13 21:08:44.687927 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 284/556] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:44 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:44.711159 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-2b08337a-76f2-4f80-8d16-1f71286dd877 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:44.718751 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-2b08337a-76f2-4f80-8d16-1f71286dd877 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1558 microversion: 2.1 time: 0.167506 Jul 13 21:08:44.719436 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 273/557] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:44 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:44.734931 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-0cc7eefe-d9c5-46db-ae61-75c469aad071 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:44.735421 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-0cc7eefe-d9c5-46db-ae61-75c469aad071 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:44.741815 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0cc7eefe-d9c5-46db-ae61-75c469aad071 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:44.742247 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0cc7eefe-d9c5-46db-ae61-75c469aad071 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:44.743030 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0cc7eefe-d9c5-46db-ae61-75c469aad071 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:44.743777 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0cc7eefe-d9c5-46db-ae61-75c469aad071 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:44.821797 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-0cc7eefe-d9c5-46db-ae61-75c469aad071 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090692 Jul 13 21:08:44.822388 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 285/558] 10.222.0.39 () {58 vars in 1274 bytes} [Wed Jul 13 21:08:44 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:08:44.959698 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b856ad22-dca4-4ae5-b251-90041871cb96 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:44.960590 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b856ad22-dca4-4ae5-b251-90041871cb96 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:44.967850 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b856ad22-dca4-4ae5-b251-90041871cb96 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:44.968718 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b856ad22-dca4-4ae5-b251-90041871cb96 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:44.969890 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b856ad22-dca4-4ae5-b251-90041871cb96 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:44.970419 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b856ad22-dca4-4ae5-b251-90041871cb96 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:45.165844 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b856ad22-dca4-4ae5-b251-90041871cb96 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:45.174304 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b856ad22-dca4-4ae5-b251-90041871cb96 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:45.176415 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b856ad22-dca4-4ae5-b251-90041871cb96 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:45.177569 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b856ad22-dca4-4ae5-b251-90041871cb96 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1744 microversion: 2.20 time: 0.222596 Jul 13 21:08:45.178319 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 274/559] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:44 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1744 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:08:45.518020 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-524b7add-e723-4c7f-9ef4-cd44290a6b14 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:45.519148 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-524b7add-e723-4c7f-9ef4-cd44290a6b14 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:45.525969 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-524b7add-e723-4c7f-9ef4-cd44290a6b14 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:45.526414 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-524b7add-e723-4c7f-9ef4-cd44290a6b14 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:45.527220 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-524b7add-e723-4c7f-9ef4-cd44290a6b14 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:45.527654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-524b7add-e723-4c7f-9ef4-cd44290a6b14 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:45.532649 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=100 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:08:45.704346 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-26b0677f-af0d-40ed-8203-55b1cd0afbd0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:45.704889 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-26b0677f-af0d-40ed-8203-55b1cd0afbd0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:45.711041 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-26b0677f-af0d-40ed-8203-55b1cd0afbd0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:45.711488 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-26b0677f-af0d-40ed-8203-55b1cd0afbd0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:45.712243 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-26b0677f-af0d-40ed-8203-55b1cd0afbd0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:45.712673 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-26b0677f-af0d-40ed-8203-55b1cd0afbd0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:45.851114 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-26b0677f-af0d-40ed-8203-55b1cd0afbd0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:45.858656 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-26b0677f-af0d-40ed-8203-55b1cd0afbd0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1522 microversion: 2.1 time: 0.158154 Jul 13 21:08:45.859530 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 275/560] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:45 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:45.864490 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-15938c5a-4249-4106-af94-62ebc90ff73e tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:45.866038 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-15938c5a-4249-4106-af94-62ebc90ff73e tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:45.871645 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-15938c5a-4249-4106-af94-62ebc90ff73e tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:45.872149 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-15938c5a-4249-4106-af94-62ebc90ff73e tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:45.872444 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-524b7add-e723-4c7f-9ef4-cd44290a6b14 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:45.872984 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-15938c5a-4249-4106-af94-62ebc90ff73e tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:45.873424 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-15938c5a-4249-4106-af94-62ebc90ff73e tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:45.880553 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-524b7add-e723-4c7f-9ef4-cd44290a6b14 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1723 microversion: 2.1 time: 0.366561 Jul 13 21:08:45.881123 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 286/561] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:45 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1723 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:45.899084 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-15938c5a-4249-4106-af94-62ebc90ff73e tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Going to try to terminate instance {{(pid=118444) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 21:08:45.986373 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-15938c5a-4249-4106-af94-62ebc90ff73e tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 204 len: 0 microversion: 2.1 time: 0.125236 Jul 13 21:08:45.987397 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 276/562] 10.222.0.39 () {58 vars in 1238 bytes} [Wed Jul 13 21:08:45 2022] DELETE /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 21:08:45.995559 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-958185d8-c7a2-49be-aaf6-08e03aacf598 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:45.996427 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-958185d8-c7a2-49be-aaf6-08e03aacf598 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:46.002290 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-958185d8-c7a2-49be-aaf6-08e03aacf598 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:46.003022 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-958185d8-c7a2-49be-aaf6-08e03aacf598 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:46.003812 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-958185d8-c7a2-49be-aaf6-08e03aacf598 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:46.004239 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-958185d8-c7a2-49be-aaf6-08e03aacf598 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:46.059773 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-c30c5f6f-6f8e-4c4d-9029-50f0e4ca74e2 req-a291f916-4684-4cb5-aeb8-a572cf3b614b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a127418-a227-4cf6-a36c-822265e0b11f", "tag": "4db6331d-2b48-476c-a5bb-5ae20a91bf9d"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:08:46.068059 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-c30c5f6f-6f8e-4c4d-9029-50f0e4ca74e2 req-a291f916-4684-4cb5-aeb8-a572cf3b614b service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:46.068626 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-c30c5f6f-6f8e-4c4d-9029-50f0e4ca74e2 req-a291f916-4684-4cb5-aeb8-a572cf3b614b service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:46.079882 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-c30c5f6f-6f8e-4c4d-9029-50f0e4ca74e2 req-a291f916-4684-4cb5-aeb8-a572cf3b614b service nova] Creating event network-changed:4db6331d-2b48-476c-a5bb-5ae20a91bf9d for instance 8a127418-a227-4cf6-a36c-822265e0b11f on hv-cinder-79987 Jul 13 21:08:46.085473 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-c30c5f6f-6f8e-4c4d-9029-50f0e4ca74e2 req-a291f916-4684-4cb5-aeb8-a572cf3b614b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029668 Jul 13 21:08:46.086405 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 277/563] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:08:46.141604 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-958185d8-c7a2-49be-aaf6-08e03aacf598 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:46.150076 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-958185d8-c7a2-49be-aaf6-08e03aacf598 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1513 microversion: 2.1 time: 0.158287 Jul 13 21:08:46.150663 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 287/564] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:45 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:46.196462 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-2f0e8f03-ec63-46f9-8d33-3d11d8e3b994 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:46.197265 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-2f0e8f03-ec63-46f9-8d33-3d11d8e3b994 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:46.203725 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2f0e8f03-ec63-46f9-8d33-3d11d8e3b994 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:46.204285 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2f0e8f03-ec63-46f9-8d33-3d11d8e3b994 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:46.205123 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2f0e8f03-ec63-46f9-8d33-3d11d8e3b994 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:46.205634 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2f0e8f03-ec63-46f9-8d33-3d11d8e3b994 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:46.337863 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-2f0e8f03-ec63-46f9-8d33-3d11d8e3b994 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:46.345737 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-2f0e8f03-ec63-46f9-8d33-3d11d8e3b994 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:46.347311 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-2f0e8f03-ec63-46f9-8d33-3d11d8e3b994 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:46.348403 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-2f0e8f03-ec63-46f9-8d33-3d11d8e3b994 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1744 microversion: 2.20 time: 0.156254 Jul 13 21:08:46.348967 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 278/565] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:46 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:46.876463 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-9fb3a2e3-f5da-4ed2-8fce-c9add0466227 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:46.876902 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-9fb3a2e3-f5da-4ed2-8fce-c9add0466227 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:46.884077 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9fb3a2e3-f5da-4ed2-8fce-c9add0466227 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:46.884521 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9fb3a2e3-f5da-4ed2-8fce-c9add0466227 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:46.885283 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9fb3a2e3-f5da-4ed2-8fce-c9add0466227 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:46.885734 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9fb3a2e3-f5da-4ed2-8fce-c9add0466227 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:46.897457 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-f2a6a1c1-78d5-4824-8b86-268a8cc2261a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:46.898062 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-f2a6a1c1-78d5-4824-8b86-268a8cc2261a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:46.904780 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f2a6a1c1-78d5-4824-8b86-268a8cc2261a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:46.905221 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f2a6a1c1-78d5-4824-8b86-268a8cc2261a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:46.906127 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f2a6a1c1-78d5-4824-8b86-268a8cc2261a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:46.906784 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f2a6a1c1-78d5-4824-8b86-268a8cc2261a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:47.027809 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-9fb3a2e3-f5da-4ed2-8fce-c9add0466227 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:47.036672 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-9fb3a2e3-f5da-4ed2-8fce-c9add0466227 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1522 microversion: 2.1 time: 0.164179 Jul 13 21:08:47.037634 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 288/566] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:46 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:47.167350 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-9de7b55a-09a0-460e-8c8e-b68d4e8be321 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:47.168076 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-9de7b55a-09a0-460e-8c8e-b68d4e8be321 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:47.180300 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9de7b55a-09a0-460e-8c8e-b68d4e8be321 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:47.180746 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9de7b55a-09a0-460e-8c8e-b68d4e8be321 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:47.181520 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9de7b55a-09a0-460e-8c8e-b68d4e8be321 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:47.181951 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9de7b55a-09a0-460e-8c8e-b68d4e8be321 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:47.306876 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f2a6a1c1-78d5-4824-8b86-268a8cc2261a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:47.315048 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-f2a6a1c1-78d5-4824-8b86-268a8cc2261a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1723 microversion: 2.1 time: 0.421735 Jul 13 21:08:47.315613 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 279/567] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:46 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1723 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:47.317991 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-9de7b55a-09a0-460e-8c8e-b68d4e8be321 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:47.325600 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-9de7b55a-09a0-460e-8c8e-b68d4e8be321 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1513 microversion: 2.1 time: 0.162363 Jul 13 21:08:47.326155 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 289/568] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:47 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:47.365408 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-99e25c71-931d-4993-bdf7-6991ce714e4a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:47.365998 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-99e25c71-931d-4993-bdf7-6991ce714e4a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:47.372016 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-99e25c71-931d-4993-bdf7-6991ce714e4a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:47.372454 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-99e25c71-931d-4993-bdf7-6991ce714e4a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:47.373192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-99e25c71-931d-4993-bdf7-6991ce714e4a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:47.373649 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-99e25c71-931d-4993-bdf7-6991ce714e4a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:47.500047 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-99e25c71-931d-4993-bdf7-6991ce714e4a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:47.508423 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-99e25c71-931d-4993-bdf7-6991ce714e4a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:47.509889 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-99e25c71-931d-4993-bdf7-6991ce714e4a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:47.511054 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-99e25c71-931d-4993-bdf7-6991ce714e4a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1744 microversion: 2.20 time: 0.149397 Jul 13 21:08:47.511613 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 280/569] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:47 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:48.054048 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-4b94b002-14bb-4c68-8c8b-c4b2da3286f6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:48.054581 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-4b94b002-14bb-4c68-8c8b-c4b2da3286f6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:48.061050 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4b94b002-14bb-4c68-8c8b-c4b2da3286f6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:48.061493 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4b94b002-14bb-4c68-8c8b-c4b2da3286f6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:48.062280 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4b94b002-14bb-4c68-8c8b-c4b2da3286f6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:48.062744 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4b94b002-14bb-4c68-8c8b-c4b2da3286f6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:48.192406 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-4b94b002-14bb-4c68-8c8b-c4b2da3286f6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:48.199669 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-4b94b002-14bb-4c68-8c8b-c4b2da3286f6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1522 microversion: 2.1 time: 0.150361 Jul 13 21:08:48.200225 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 290/570] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:48 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:48.332890 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-c47e55a6-271e-45ad-9993-382a1393f721 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:48.333418 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-c47e55a6-271e-45ad-9993-382a1393f721 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:48.339882 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c47e55a6-271e-45ad-9993-382a1393f721 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:48.340327 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c47e55a6-271e-45ad-9993-382a1393f721 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:48.341069 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c47e55a6-271e-45ad-9993-382a1393f721 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:48.341497 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c47e55a6-271e-45ad-9993-382a1393f721 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:48.342412 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-fdbfc49d-7550-4474-b392-8ae3571d529c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:48.343042 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-fdbfc49d-7550-4474-b392-8ae3571d529c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:48.349706 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-fdbfc49d-7550-4474-b392-8ae3571d529c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:48.350154 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-fdbfc49d-7550-4474-b392-8ae3571d529c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:48.350921 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-fdbfc49d-7550-4474-b392-8ae3571d529c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:48.351343 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-fdbfc49d-7550-4474-b392-8ae3571d529c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:48.467379 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-c47e55a6-271e-45ad-9993-382a1393f721 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:48.475877 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-c47e55a6-271e-45ad-9993-382a1393f721 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1723 microversion: 2.1 time: 0.147279 Jul 13 21:08:48.476450 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 281/571] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:48 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:48.478539 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-fdbfc49d-7550-4474-b392-8ae3571d529c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:48.486109 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-fdbfc49d-7550-4474-b392-8ae3571d529c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1513 microversion: 2.1 time: 0.147431 Jul 13 21:08:48.486673 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 291/572] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:48 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:48.529070 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-946f43bd-27c2-4648-bf31-65dd631c8d4d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:48.529758 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-946f43bd-27c2-4648-bf31-65dd631c8d4d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:48.536365 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-946f43bd-27c2-4648-bf31-65dd631c8d4d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:48.536888 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-946f43bd-27c2-4648-bf31-65dd631c8d4d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:48.537655 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-946f43bd-27c2-4648-bf31-65dd631c8d4d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:48.538116 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-946f43bd-27c2-4648-bf31-65dd631c8d4d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:48.674109 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-946f43bd-27c2-4648-bf31-65dd631c8d4d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:48.681821 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-946f43bd-27c2-4648-bf31-65dd631c8d4d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:48.683324 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-946f43bd-27c2-4648-bf31-65dd631c8d4d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:48.684450 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-946f43bd-27c2-4648-bf31-65dd631c8d4d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1744 microversion: 2.20 time: 0.159199 Jul 13 21:08:48.685009 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 282/573] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:48 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:49.218242 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-3b1b9be2-081e-42a4-b817-cf5369378671 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:49.218907 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-3b1b9be2-081e-42a4-b817-cf5369378671 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:49.227073 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3b1b9be2-081e-42a4-b817-cf5369378671 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:49.227523 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3b1b9be2-081e-42a4-b817-cf5369378671 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:49.228480 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3b1b9be2-081e-42a4-b817-cf5369378671 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:49.229697 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3b1b9be2-081e-42a4-b817-cf5369378671 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:49.377250 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3b1b9be2-081e-42a4-b817-cf5369378671 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:49.388328 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-3b1b9be2-081e-42a4-b817-cf5369378671 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1522 microversion: 2.1 time: 0.174816 Jul 13 21:08:49.389403 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 292/574] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:49 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:49.492871 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-10c05a38-e486-4093-b18c-f1ce04df3960 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:49.494081 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-10c05a38-e486-4093-b18c-f1ce04df3960 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:49.502554 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c4b61cd2-c2a4-41d8-a900-1f5a6d03d86e tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:49.503413 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-c4b61cd2-c2a4-41d8-a900-1f5a6d03d86e tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:49.511486 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-10c05a38-e486-4093-b18c-f1ce04df3960 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:49.512231 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-10c05a38-e486-4093-b18c-f1ce04df3960 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:49.512549 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c4b61cd2-c2a4-41d8-a900-1f5a6d03d86e tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:49.513276 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-10c05a38-e486-4093-b18c-f1ce04df3960 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:49.514028 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-10c05a38-e486-4093-b18c-f1ce04df3960 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:49.517374 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c4b61cd2-c2a4-41d8-a900-1f5a6d03d86e tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:49.520249 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c4b61cd2-c2a4-41d8-a900-1f5a6d03d86e tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:49.520249 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c4b61cd2-c2a4-41d8-a900-1f5a6d03d86e tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:49.615612 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c4b61cd2-c2a4-41d8-a900-1f5a6d03d86e tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:49.624870 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-c4b61cd2-c2a4-41d8-a900-1f5a6d03d86e tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1471 microversion: 2.1 time: 0.126020 Jul 13 21:08:49.625976 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 293/575] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:49 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1471 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:49.668744 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-b6d71896-a238-4898-a8ed-1b79b48ff63e req-c7333439-63fb-4f47-9753-cb23e2dc8b98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d43b7a85-7ba7-404c-b1f7-56e9bebc4532", "name": "network-vif-deleted", "tag": "317898b2-465a-4c11-b821-ef1b8829d78f"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:08:49.682375 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-b6d71896-a238-4898-a8ed-1b79b48ff63e req-c7333439-63fb-4f47-9753-cb23e2dc8b98 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:49.682984 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-b6d71896-a238-4898-a8ed-1b79b48ff63e req-c7333439-63fb-4f47-9753-cb23e2dc8b98 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:49.698360 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-b6d71896-a238-4898-a8ed-1b79b48ff63e req-c7333439-63fb-4f47-9753-cb23e2dc8b98 service nova] Creating event network-vif-deleted:317898b2-465a-4c11-b821-ef1b8829d78f for instance d43b7a85-7ba7-404c-b1f7-56e9bebc4532 on hv-cinder-79987 Jul 13 21:08:49.704203 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-b6d71896-a238-4898-a8ed-1b79b48ff63e req-c7333439-63fb-4f47-9753-cb23e2dc8b98 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039823 Jul 13 21:08:49.705549 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 294/576] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:08:49.711484 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-e705fe3e-d587-41af-baa3-8b9e83113b74 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:49.712281 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-e705fe3e-d587-41af-baa3-8b9e83113b74 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:49.719860 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e705fe3e-d587-41af-baa3-8b9e83113b74 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:49.720393 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e705fe3e-d587-41af-baa3-8b9e83113b74 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:49.721238 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e705fe3e-d587-41af-baa3-8b9e83113b74 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:49.721822 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e705fe3e-d587-41af-baa3-8b9e83113b74 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:49.744103 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-10c05a38-e486-4093-b18c-f1ce04df3960 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:49.752564 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-10c05a38-e486-4093-b18c-f1ce04df3960 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1723 microversion: 2.1 time: 0.263412 Jul 13 21:08:49.753537 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 283/577] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:49 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:49.860691 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-e705fe3e-d587-41af-baa3-8b9e83113b74 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:49.870004 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-e705fe3e-d587-41af-baa3-8b9e83113b74 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:49.871814 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-e705fe3e-d587-41af-baa3-8b9e83113b74 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:49.873086 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-e705fe3e-d587-41af-baa3-8b9e83113b74 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1739 microversion: 2.20 time: 0.166431 Jul 13 21:08:49.874076 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 295/578] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:49 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:50.406673 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-9e857b1c-3a86-4d6d-84c5-37d217675836 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:50.407303 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-9e857b1c-3a86-4d6d-84c5-37d217675836 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:50.414473 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9e857b1c-3a86-4d6d-84c5-37d217675836 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:50.414936 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9e857b1c-3a86-4d6d-84c5-37d217675836 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:50.415884 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9e857b1c-3a86-4d6d-84c5-37d217675836 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:50.416574 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9e857b1c-3a86-4d6d-84c5-37d217675836 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:50.549590 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-9e857b1c-3a86-4d6d-84c5-37d217675836 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:50.554686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:08:50.559855 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-9e857b1c-3a86-4d6d-84c5-37d217675836 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1522 microversion: 2.1 time: 0.157133 Jul 13 21:08:50.568420 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 284/579] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:50 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:50.644515 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-5e994f97-7245-4046-828c-c92ea1ae5a88 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:50.645404 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-5e994f97-7245-4046-828c-c92ea1ae5a88 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:50.652982 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5e994f97-7245-4046-828c-c92ea1ae5a88 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:50.653641 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5e994f97-7245-4046-828c-c92ea1ae5a88 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:50.654472 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5e994f97-7245-4046-828c-c92ea1ae5a88 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:50.654941 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5e994f97-7245-4046-828c-c92ea1ae5a88 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:50.742060 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5e994f97-7245-4046-828c-c92ea1ae5a88 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:50.751217 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-5e994f97-7245-4046-828c-c92ea1ae5a88 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1471 microversion: 2.1 time: 0.111314 Jul 13 21:08:50.752259 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 296/580] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:50 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1471 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:50.773565 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-5f6e2058-5dc7-4f20-8f50-022673059f9f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:50.774171 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-5f6e2058-5dc7-4f20-8f50-022673059f9f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:50.784158 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5f6e2058-5dc7-4f20-8f50-022673059f9f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:50.784639 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5f6e2058-5dc7-4f20-8f50-022673059f9f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:50.786993 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5f6e2058-5dc7-4f20-8f50-022673059f9f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:50.787685 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5f6e2058-5dc7-4f20-8f50-022673059f9f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:50.892007 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-da32b685-1157-49c7-aa93-cee8f91530a0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:50.892752 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-da32b685-1157-49c7-aa93-cee8f91530a0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:50.899768 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-da32b685-1157-49c7-aa93-cee8f91530a0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:50.900361 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-da32b685-1157-49c7-aa93-cee8f91530a0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:50.901229 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-da32b685-1157-49c7-aa93-cee8f91530a0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:50.901766 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-da32b685-1157-49c7-aa93-cee8f91530a0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:51.018451 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-5f6e2058-5dc7-4f20-8f50-022673059f9f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:51.039144 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-5f6e2058-5dc7-4f20-8f50-022673059f9f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1723 microversion: 2.1 time: 0.271688 Jul 13 21:08:51.052132 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 285/581] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:50 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1723 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:51.094688 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-da32b685-1157-49c7-aa93-cee8f91530a0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:51.111162 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-da32b685-1157-49c7-aa93-cee8f91530a0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:51.117584 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-da32b685-1157-49c7-aa93-cee8f91530a0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:51.118815 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-da32b685-1157-49c7-aa93-cee8f91530a0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1739 microversion: 2.20 time: 0.230582 Jul 13 21:08:51.119583 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 297/582] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:50 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1739 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:08:51.578242 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-8a53823d-615d-44d9-9039-128862ff8eb7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:51.579602 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-8a53823d-615d-44d9-9039-128862ff8eb7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:51.602121 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8a53823d-615d-44d9-9039-128862ff8eb7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:51.602810 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8a53823d-615d-44d9-9039-128862ff8eb7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:51.604301 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8a53823d-615d-44d9-9039-128862ff8eb7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:51.604864 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8a53823d-615d-44d9-9039-128862ff8eb7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:51.763940 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-8a53823d-615d-44d9-9039-128862ff8eb7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:51.772750 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-4d9535f5-0805-4e5b-88a5-0ba52d47634f tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:51.773320 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-8a53823d-615d-44d9-9039-128862ff8eb7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1522 microversion: 2.1 time: 0.199495 Jul 13 21:08:51.773417 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-4d9535f5-0805-4e5b-88a5-0ba52d47634f tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:51.782868 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 286/583] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:51 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:51.783057 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4d9535f5-0805-4e5b-88a5-0ba52d47634f tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:51.783057 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4d9535f5-0805-4e5b-88a5-0ba52d47634f tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:51.783057 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4d9535f5-0805-4e5b-88a5-0ba52d47634f tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:51.783057 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4d9535f5-0805-4e5b-88a5-0ba52d47634f tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:51.832475 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4d9535f5-0805-4e5b-88a5-0ba52d47634f tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:51.832822 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4d9535f5-0805-4e5b-88a5-0ba52d47634f tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:51.833266 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.objects.instance [None req-4d9535f5-0805-4e5b-88a5-0ba52d47634f tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lazy-loading 'fault' on Instance uuid d43b7a85-7ba7-404c-b1f7-56e9bebc4532 {{(pid=118445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:08:51.873639 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-4d9535f5-0805-4e5b-88a5-0ba52d47634f tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:51.881368 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-4d9535f5-0805-4e5b-88a5-0ba52d47634f tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 200 len: 1308 microversion: 2.1 time: 0.114510 Jul 13 21:08:51.882648 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 298/584] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:51 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 1308 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:52.060056 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-654eb068-cba1-4dc2-9ce1-67d535a34282 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:52.060753 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-654eb068-cba1-4dc2-9ce1-67d535a34282 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:52.068812 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-654eb068-cba1-4dc2-9ce1-67d535a34282 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:52.069317 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-654eb068-cba1-4dc2-9ce1-67d535a34282 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:52.070114 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-654eb068-cba1-4dc2-9ce1-67d535a34282 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:52.070687 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-654eb068-cba1-4dc2-9ce1-67d535a34282 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:52.137013 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ec961389-e7b7-4a14-9613-bfd490ec349d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:52.137614 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ec961389-e7b7-4a14-9613-bfd490ec349d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:52.146886 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ec961389-e7b7-4a14-9613-bfd490ec349d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:52.147539 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ec961389-e7b7-4a14-9613-bfd490ec349d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:52.148346 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ec961389-e7b7-4a14-9613-bfd490ec349d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:52.148776 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ec961389-e7b7-4a14-9613-bfd490ec349d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:52.235682 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-654eb068-cba1-4dc2-9ce1-67d535a34282 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:52.244701 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-654eb068-cba1-4dc2-9ce1-67d535a34282 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1723 microversion: 2.1 time: 0.188773 Jul 13 21:08:52.245279 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 287/585] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:52 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:52.289699 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ec961389-e7b7-4a14-9613-bfd490ec349d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:52.297524 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ec961389-e7b7-4a14-9613-bfd490ec349d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:52.299001 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ec961389-e7b7-4a14-9613-bfd490ec349d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:52.300128 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ec961389-e7b7-4a14-9613-bfd490ec349d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1739 microversion: 2.20 time: 0.166970 Jul 13 21:08:52.306281 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 299/586] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:52 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:52.790710 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ab07b265-a9b0-439e-93ff-791ee106c184 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:52.791417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-ab07b265-a9b0-439e-93ff-791ee106c184 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:52.798810 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ab07b265-a9b0-439e-93ff-791ee106c184 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:52.799884 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ab07b265-a9b0-439e-93ff-791ee106c184 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:52.800715 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ab07b265-a9b0-439e-93ff-791ee106c184 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:52.801150 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ab07b265-a9b0-439e-93ff-791ee106c184 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:52.897923 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-2278a292-8002-41d3-9ae5-13336c17e321 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:52.898498 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-2278a292-8002-41d3-9ae5-13336c17e321 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: d43b7a85-7ba7-404c-b1f7-56e9bebc4532] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:52.905554 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2278a292-8002-41d3-9ae5-13336c17e321 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:52.906003 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2278a292-8002-41d3-9ae5-13336c17e321 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:52.906808 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2278a292-8002-41d3-9ae5-13336c17e321 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:52.907253 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2278a292-8002-41d3-9ae5-13336c17e321 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:52.934136 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.wsgi [None req-2278a292-8002-41d3-9ae5-13336c17e321 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] HTTP exception thrown: Instance d43b7a85-7ba7-404c-b1f7-56e9bebc4532 could not be found. Jul 13 21:08:52.935831 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-2278a292-8002-41d3-9ae5-13336c17e321 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Request method failure captured: Jul 13 21:08:52.935831 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: request: GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 HTTP/1.1 Jul 13 21:08:52.935831 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept: application/json Jul 13 21:08:52.935831 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept-Encoding: identity Jul 13 21:08:52.935831 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Connection: close Jul 13 21:08:52.935831 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Length: 0 Jul 13 21:08:52.935831 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Type: application/json Jul 13 21:08:52.935831 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Host: 10.222.0.39 Jul 13 21:08:52.935831 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Openstack-System-Scope: None Jul 13 21:08:52.935831 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: User-Agent: python-urllib3/1.26.9 Jul 13 21:08:52.935831 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Auth-Token: gAAAAABizzP35idd4F4638Gwp2bitPASGdNQfRyp7UPMJyMQwSxVCn3ajkGdV-UPLCH0k0Top6sNHlWXZxWInENwdwVUMuDP2UVov4IZTkvA9OKeXpbSpv-LL1KltoIzqYS8rApU8GhTryLzXAVeeK-QKCcJ0qyS84rqUH3m4MuCww7dPd8Q1H4 Jul 13 21:08:52.935831 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Id: None Jul 13 21:08:52.935831 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Name: None Jul 13 21:08:52.935831 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Identity-Status: Confirmed Jul 13 21:08:52.935831 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Is-Admin-Project: True Jul 13 21:08:52.935831 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Id: default Jul 13 21:08:52.935831 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Name: Default Jul 13 21:08:52.935831 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Id: 2332a661874a4a2faebb32a154be663c Jul 13 21:08:52.935831 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Name: tempest-VolumesSnapshotTestJSON-863081210 Jul 13 21:08:52.935831 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Role: member,reader Jul 13 21:08:52.935831 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Roles: member,reader Jul 13 21:08:52.937184 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2332a661874a4a2faebb32a154be663c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2332a661874a4a2faebb32a154be663c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2332a661874a4a2faebb32a154be663c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2332a661874a4a2faebb32a154be663c"}]}] Jul 13 21:08:52.937184 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant: tempest-VolumesSnapshotTestJSON-863081210 Jul 13 21:08:52.937184 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Id: 2332a661874a4a2faebb32a154be663c Jul 13 21:08:52.937184 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-863081210 Jul 13 21:08:52.937184 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User: tempest-VolumesSnapshotTestJSON-863081210-project Jul 13 21:08:52.937184 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Id: default Jul 13 21:08:52.937184 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Name: Default Jul 13 21:08:52.937184 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Id: c9074c8e166b4cd2a3cff41f0ccca273 Jul 13 21:08:52.937184 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Name: tempest-VolumesSnapshotTestJSON-863081210-project Jul 13 21:08:52.937184 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: method: > Jul 13 21:08:52.937184 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: exception: Instance d43b7a85-7ba7-404c-b1f7-56e9bebc4532 could not be found. Jul 13 21:08:52.937184 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: action_args: {'id': 'd43b7a85-7ba7-404c-b1f7-56e9bebc4532'} Jul 13 21:08:52.937993 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:08:52.937993 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:08:52.937993 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:08:52.937993 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:08:52.937993 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:08:52.937993 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:08:52.937993 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:08:52.937993 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:08:52.937993 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:08:52.937993 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:08:52.937993 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d43b7a85-7ba7-404c-b1f7-56e9bebc4532 could not be found. Jul 13 21:08:52.937993 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:08:52.937993 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:08:52.937993 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:08:52.937993 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:08:52.937993 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:08:52.937993 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:08:52.937993 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:08:52.937993 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:08:52.937993 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:08:52.939301 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:08:52.939301 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 21:08:52.939301 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 21:08:52.939301 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:08:52.939301 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:08:52.939301 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:08:52.939301 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:08:52.939301 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d43b7a85-7ba7-404c-b1f7-56e9bebc4532 could not be found. Jul 13 21:08:52.939301 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:08:52.939301 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:08:52.939301 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:08:52.939301 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:08:52.939301 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:08:52.939301 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:08:52.939301 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:08:52.939301 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:08:52.939301 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d43b7a85-7ba7-404c-b1f7-56e9bebc4532 could not be found. Jul 13 21:08:52.939301 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:08:52.940400 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-2278a292-8002-41d3-9ae5-13336c17e321 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Returning 404 to user: Instance d43b7a85-7ba7-404c-b1f7-56e9bebc4532 could not be found. {{(pid=118445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:08:52.940400 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-2278a292-8002-41d3-9ae5-13336c17e321 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532" status: 404 len: 111 microversion: 2.1 time: 0.043926 Jul 13 21:08:52.943281 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 300/587] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:52 2022] GET /compute/v2.1/servers/d43b7a85-7ba7-404c-b1f7-56e9bebc4532 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:08:52.978305 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ab07b265-a9b0-439e-93ff-791ee106c184 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:52.986537 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ab07b265-a9b0-439e-93ff-791ee106c184 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1522 microversion: 2.1 time: 0.199576 Jul 13 21:08:52.989748 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 288/588] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:52 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:53.263768 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-36b46215-f0a5-4d26-bedd-4cc3999074f5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:53.264413 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-36b46215-f0a5-4d26-bedd-4cc3999074f5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:53.271765 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-36b46215-f0a5-4d26-bedd-4cc3999074f5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:53.272206 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-36b46215-f0a5-4d26-bedd-4cc3999074f5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:53.273183 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-36b46215-f0a5-4d26-bedd-4cc3999074f5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:53.273416 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-36b46215-f0a5-4d26-bedd-4cc3999074f5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:53.320598 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-c2dd0159-826c-4f10-b9e4-703c40fa2324 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:53.321711 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-c2dd0159-826c-4f10-b9e4-703c40fa2324 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:53.329335 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c2dd0159-826c-4f10-b9e4-703c40fa2324 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:53.330118 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c2dd0159-826c-4f10-b9e4-703c40fa2324 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:53.331499 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c2dd0159-826c-4f10-b9e4-703c40fa2324 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:53.333301 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c2dd0159-826c-4f10-b9e4-703c40fa2324 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:53.414734 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-36b46215-f0a5-4d26-bedd-4cc3999074f5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:53.424211 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-36b46215-f0a5-4d26-bedd-4cc3999074f5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1723 microversion: 2.1 time: 0.164759 Jul 13 21:08:53.434438 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 301/589] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:53 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:53.484887 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-c2dd0159-826c-4f10-b9e4-703c40fa2324 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:53.493730 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-c2dd0159-826c-4f10-b9e4-703c40fa2324 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:53.496653 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-c2dd0159-826c-4f10-b9e4-703c40fa2324 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:53.496653 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-c2dd0159-826c-4f10-b9e4-703c40fa2324 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1739 microversion: 2.20 time: 0.180808 Jul 13 21:08:53.497922 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 289/590] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:53 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:08:54.010768 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-73476a7b-b860-430d-85de-3f7143494637 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:54.012102 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-73476a7b-b860-430d-85de-3f7143494637 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:54.026347 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-73476a7b-b860-430d-85de-3f7143494637 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:54.029177 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-73476a7b-b860-430d-85de-3f7143494637 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:54.029960 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-73476a7b-b860-430d-85de-3f7143494637 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:54.030394 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-73476a7b-b860-430d-85de-3f7143494637 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:54.171787 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-73476a7b-b860-430d-85de-3f7143494637 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:54.181605 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-73476a7b-b860-430d-85de-3f7143494637 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1502 microversion: 2.1 time: 0.180058 Jul 13 21:08:54.182593 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 302/591] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:54 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1502 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:54.202725 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-cf89b299-aed0-4669-b621-ce3cc83d5e0c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2f1721f-84dc-4a6d-84c4-21d8c9ce76d9"}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:08:54.204159 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-cf89b299-aed0-4669-b621-ce3cc83d5e0c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:54.210981 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-cf89b299-aed0-4669-b621-ce3cc83d5e0c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:54.211510 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-cf89b299-aed0-4669-b621-ce3cc83d5e0c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:54.212357 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-cf89b299-aed0-4669-b621-ce3cc83d5e0c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:54.212902 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-cf89b299-aed0-4669-b621-ce3cc83d5e0c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:54.237559 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.wsgi [None req-cf89b299-aed0-4669-b621-ce3cc83d5e0c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] HTTP exception thrown: Cannot 'attach_volume' instance b0f6b2e3-dfe2-417f-a343-d2d9b990df70 while it is in vm_state rescued Jul 13 21:08:54.239418 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-cf89b299-aed0-4669-b621-ce3cc83d5e0c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Request method failure captured: Jul 13 21:08:54.239418 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: request: POST /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70/os-volume_attachments HTTP/1.1 Jul 13 21:08:54.239418 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept: application/json Jul 13 21:08:54.239418 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept-Encoding: identity Jul 13 21:08:54.239418 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Connection: close Jul 13 21:08:54.239418 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Length: 74 Jul 13 21:08:54.239418 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Type: application/json Jul 13 21:08:54.239418 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Host: 10.222.0.39 Jul 13 21:08:54.239418 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Openstack-System-Scope: None Jul 13 21:08:54.239418 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: User-Agent: python-urllib3/1.26.9 Jul 13 21:08:54.239418 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Auth-Token: gAAAAABizzPtXHqQhWpxQh2KXbvi9Mgpby3iRjpl1OJ_e5HYVB22nvOaYbWB2MpVdcW6zYVpUTz-raJVgo1KpIKJjd8jQvSDDnfI08IVf2HZpBBPAsy36vIdZqbCwpfLiW8Y5tS--8G7qgwaLY75cvFnltcDSVPPHdqKdNVl_OBtO9Qz2UoyQNk Jul 13 21:08:54.239418 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Id: None Jul 13 21:08:54.239418 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Name: None Jul 13 21:08:54.239418 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Identity-Status: Confirmed Jul 13 21:08:54.239418 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Is-Admin-Project: True Jul 13 21:08:54.239418 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Id: default Jul 13 21:08:54.239418 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Name: Default Jul 13 21:08:54.239418 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Id: c1d4119a1d0b474fb568818f1aaa933b Jul 13 21:08:54.239418 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-156399502 Jul 13 21:08:54.239418 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Role: member,reader Jul 13 21:08:54.239418 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Roles: member,reader Jul 13 21:08:54.240744 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c1d4119a1d0b474fb568818f1aaa933b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c1d4119a1d0b474fb568818f1aaa933b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c1d4119a1d0b474fb568818f1aaa933b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c1d4119a1d0b474fb568818f1aaa933b"}]}] Jul 13 21:08:54.240744 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant: tempest-ServerRescueNegativeTestJSON-156399502 Jul 13 21:08:54.240744 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Id: c1d4119a1d0b474fb568818f1aaa933b Jul 13 21:08:54.240744 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-156399502 Jul 13 21:08:54.240744 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User: tempest-ServerRescueNegativeTestJSON-156399502-project Jul 13 21:08:54.240744 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Id: default Jul 13 21:08:54.240744 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Name: Default Jul 13 21:08:54.240744 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Id: dc40c07fceab4a83ba9324da868034aa Jul 13 21:08:54.240744 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Name: tempest-ServerRescueNegativeTestJSON-156399502-project Jul 13 21:08:54.240744 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Jul 13 21:08:54.240744 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: {"volumeAttachment": {"volumeId": "a2f1721f-84dc-4a6d-84c4-21d8c9ce76d9"}} Jul 13 21:08:54.240744 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: method: > Jul 13 21:08:54.241493 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: exception: Cannot 'attach_volume' instance b0f6b2e3-dfe2-417f-a343-d2d9b990df70 while it is in vm_state rescued Jul 13 21:08:54.241493 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: action_args: {'server_id': 'b0f6b2e3-dfe2-417f-a343-d2d9b990df70', 'body': {'volumeAttachment': {'volumeId': 'a2f1721f-84dc-4a6d-84c4-21d8c9ce76d9'}}} Jul 13 21:08:54.241493 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:08:54.241493 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:08:54.241493 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 13 21:08:54.241493 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 13 21:08:54.241493 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 13 21:08:54.241493 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 13 21:08:54.241493 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 13 21:08:54.241493 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 13 21:08:54.241493 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b0f6b2e3-dfe2-417f-a343-d2d9b990df70 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 13 21:08:54.241493 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:08:54.241493 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:08:54.241493 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:08:54.241493 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:08:54.241493 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:08:54.241493 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:08:54.241493 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:08:54.241493 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:08:54.243051 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:08:54.243051 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:08:54.243051 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 13 21:08:54.243051 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 13 21:08:54.243051 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 13 21:08:54.243051 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 13 21:08:54.243051 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 13 21:08:54.243051 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 13 21:08:54.243051 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 13 21:08:54.243051 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 13 21:08:54.243051 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 13 21:08:54.243051 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 13 21:08:54.243051 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b0f6b2e3-dfe2-417f-a343-d2d9b990df70 while it is in vm_state rescued Jul 13 21:08:54.243051 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:08:54.243051 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:08:54.243051 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:08:54.243051 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:08:54.243051 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:08:54.243051 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:08:54.244464 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:08:54.244464 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:08:54.244464 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b0f6b2e3-dfe2-417f-a343-d2d9b990df70 while it is in vm_state rescued Jul 13 21:08:54.244464 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:08:54.244464 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-cf89b299-aed0-4669-b621-ce3cc83d5e0c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Returning 409 to user: Cannot 'attach_volume' instance b0f6b2e3-dfe2-417f-a343-d2d9b990df70 while it is in vm_state rescued {{(pid=118444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:08:54.244464 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-cf89b299-aed0-4669-b621-ce3cc83d5e0c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "POST /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046325 Jul 13 21:08:54.250252 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-5e086920-9ed4-4125-8c0d-8c461b544862 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:08:54.250803 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-5e086920-9ed4-4125-8c0d-8c461b544862 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:54.253614 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 290/592] 10.222.0.39 () {60 vars in 1322 bytes} [Wed Jul 13 21:08:54 2022] POST /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 13 21:08:54.257088 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5e086920-9ed4-4125-8c0d-8c461b544862 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:54.257750 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5e086920-9ed4-4125-8c0d-8c461b544862 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:54.258533 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5e086920-9ed4-4125-8c0d-8c461b544862 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:54.259065 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5e086920-9ed4-4125-8c0d-8c461b544862 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:54.287912 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=100 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:08:54.328377 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-5e086920-9ed4-4125-8c0d-8c461b544862 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "POST /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70/action" status: 202 len: 0 microversion: 2.1 time: 0.081560 Jul 13 21:08:54.329560 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 303/593] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Jul 13 21:08:54 2022] POST /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 21:08:54.342525 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-df1e5df1-3cf1-446a-84ec-9411c06ff468 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:54.344848 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-df1e5df1-3cf1-446a-84ec-9411c06ff468 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:54.353319 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-df1e5df1-3cf1-446a-84ec-9411c06ff468 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:54.353785 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-df1e5df1-3cf1-446a-84ec-9411c06ff468 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:54.354718 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-df1e5df1-3cf1-446a-84ec-9411c06ff468 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:54.355202 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-df1e5df1-3cf1-446a-84ec-9411c06ff468 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:54.442979 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-d42f92f8-7282-40e2-8ba7-398891c40fed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:54.444272 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-d42f92f8-7282-40e2-8ba7-398891c40fed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:54.451615 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d42f92f8-7282-40e2-8ba7-398891c40fed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:54.452362 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d42f92f8-7282-40e2-8ba7-398891c40fed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:54.453292 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d42f92f8-7282-40e2-8ba7-398891c40fed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:54.453970 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d42f92f8-7282-40e2-8ba7-398891c40fed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:54.533853 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-df1e5df1-3cf1-446a-84ec-9411c06ff468 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:54.544242 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-df1e5df1-3cf1-446a-84ec-9411c06ff468 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1510 microversion: 2.1 time: 0.209637 Jul 13 21:08:54.544845 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 291/594] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:54 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1510 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:54.549941 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-2d8a88df-6446-4e73-9672-b70e30027159 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:54.550839 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-2d8a88df-6446-4e73-9672-b70e30027159 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:54.558309 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2d8a88df-6446-4e73-9672-b70e30027159 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:54.558795 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2d8a88df-6446-4e73-9672-b70e30027159 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:54.559571 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2d8a88df-6446-4e73-9672-b70e30027159 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:54.560001 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2d8a88df-6446-4e73-9672-b70e30027159 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:54.631193 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-d42f92f8-7282-40e2-8ba7-398891c40fed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:54.643695 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-d42f92f8-7282-40e2-8ba7-398891c40fed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1723 microversion: 2.1 time: 0.205539 Jul 13 21:08:54.650799 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 304/595] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:54 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:54.712160 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-2d8a88df-6446-4e73-9672-b70e30027159 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:54.721042 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-2d8a88df-6446-4e73-9672-b70e30027159 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:54.722647 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-2d8a88df-6446-4e73-9672-b70e30027159 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:54.723796 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-2d8a88df-6446-4e73-9672-b70e30027159 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1739 microversion: 2.20 time: 0.178054 Jul 13 21:08:54.724340 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 292/596] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:54 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:55.562497 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-8a815d5e-94fb-447f-b5aa-bf6bb41f7878 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:55.562497 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8a815d5e-94fb-447f-b5aa-bf6bb41f7878 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:55.565302 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_api:SELECT=100 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:08:55.571214 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8a815d5e-94fb-447f-b5aa-bf6bb41f7878 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:55.571682 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8a815d5e-94fb-447f-b5aa-bf6bb41f7878 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:55.572444 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8a815d5e-94fb-447f-b5aa-bf6bb41f7878 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:55.572871 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8a815d5e-94fb-447f-b5aa-bf6bb41f7878 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:55.661703 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-40b3676b-c612-4719-a4f2-e9453b2de9ca tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:55.662282 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-40b3676b-c612-4719-a4f2-e9453b2de9ca tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:55.673028 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-40b3676b-c612-4719-a4f2-e9453b2de9ca tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:55.673475 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-40b3676b-c612-4719-a4f2-e9453b2de9ca tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:55.674252 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-40b3676b-c612-4719-a4f2-e9453b2de9ca tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:55.675606 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-40b3676b-c612-4719-a4f2-e9453b2de9ca tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:55.716692 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8a815d5e-94fb-447f-b5aa-bf6bb41f7878 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:55.725247 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-8a815d5e-94fb-447f-b5aa-bf6bb41f7878 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1510 microversion: 2.1 time: 0.167614 Jul 13 21:08:55.735409 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 305/597] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:55 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1510 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:55.741988 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-be9b9296-5e9b-475d-b56c-d073f6fec02b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:55.742595 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-be9b9296-5e9b-475d-b56c-d073f6fec02b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:55.748998 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-be9b9296-5e9b-475d-b56c-d073f6fec02b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:55.749443 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-be9b9296-5e9b-475d-b56c-d073f6fec02b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:55.750685 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-be9b9296-5e9b-475d-b56c-d073f6fec02b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:55.750806 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-be9b9296-5e9b-475d-b56c-d073f6fec02b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:55.850604 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-40b3676b-c612-4719-a4f2-e9453b2de9ca tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:55.859687 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-40b3676b-c612-4719-a4f2-e9453b2de9ca tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1723 microversion: 2.1 time: 0.202155 Jul 13 21:08:55.870877 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 293/598] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:55 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:55.910434 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-be9b9296-5e9b-475d-b56c-d073f6fec02b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:55.919521 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-be9b9296-5e9b-475d-b56c-d073f6fec02b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:55.921018 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-be9b9296-5e9b-475d-b56c-d073f6fec02b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:55.922213 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-be9b9296-5e9b-475d-b56c-d073f6fec02b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1739 microversion: 2.20 time: 0.184824 Jul 13 21:08:55.933309 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 306/599] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:55 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:08:56.742542 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-5b919c1a-df8f-4926-814c-64c4097f67ef tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:56.743268 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-5b919c1a-df8f-4926-814c-64c4097f67ef tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:56.749742 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5b919c1a-df8f-4926-814c-64c4097f67ef tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:56.750207 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5b919c1a-df8f-4926-814c-64c4097f67ef tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:56.751025 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5b919c1a-df8f-4926-814c-64c4097f67ef tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:56.751461 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5b919c1a-df8f-4926-814c-64c4097f67ef tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:56.877278 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-80e0b86c-7a39-42f9-a574-11c3f514bb24 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:56.878051 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-80e0b86c-7a39-42f9-a574-11c3f514bb24 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:56.886515 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-80e0b86c-7a39-42f9-a574-11c3f514bb24 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:56.887107 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-80e0b86c-7a39-42f9-a574-11c3f514bb24 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:56.888074 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-80e0b86c-7a39-42f9-a574-11c3f514bb24 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:56.888572 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-80e0b86c-7a39-42f9-a574-11c3f514bb24 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:56.904539 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-5b919c1a-df8f-4926-814c-64c4097f67ef tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:56.917119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-5b919c1a-df8f-4926-814c-64c4097f67ef tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1510 microversion: 2.1 time: 0.178279 Jul 13 21:08:56.918076 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 294/600] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:56 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:56.941763 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-8cdf33a3-09b4-444f-a4e7-356453da2814 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:56.942661 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-8cdf33a3-09b4-444f-a4e7-356453da2814 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:56.949563 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8cdf33a3-09b4-444f-a4e7-356453da2814 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:56.950728 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8cdf33a3-09b4-444f-a4e7-356453da2814 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:56.951219 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8cdf33a3-09b4-444f-a4e7-356453da2814 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:56.951694 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8cdf33a3-09b4-444f-a4e7-356453da2814 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:57.060608 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-80e0b86c-7a39-42f9-a574-11c3f514bb24 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:57.075811 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-80e0b86c-7a39-42f9-a574-11c3f514bb24 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1723 microversion: 2.1 time: 0.202342 Jul 13 21:08:57.076717 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 307/601] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:56 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:08:57.107122 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-8cdf33a3-09b4-444f-a4e7-356453da2814 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:57.115273 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-8cdf33a3-09b4-444f-a4e7-356453da2814 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:57.116831 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-8cdf33a3-09b4-444f-a4e7-356453da2814 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:57.117966 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-8cdf33a3-09b4-444f-a4e7-356453da2814 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1739 microversion: 2.20 time: 0.180616 Jul 13 21:08:57.118512 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 295/602] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:56 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:08:57.943462 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-d8497f9b-a93c-462d-9cdc-357544dde0bf tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:57.944172 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-d8497f9b-a93c-462d-9cdc-357544dde0bf tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:57.962857 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d8497f9b-a93c-462d-9cdc-357544dde0bf tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:57.963391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d8497f9b-a93c-462d-9cdc-357544dde0bf tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:57.964267 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d8497f9b-a93c-462d-9cdc-357544dde0bf tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:57.964641 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d8497f9b-a93c-462d-9cdc-357544dde0bf tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:58.093684 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-324f2faa-bce0-4fd6-8982-432eef030d7b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:58.095031 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-324f2faa-bce0-4fd6-8982-432eef030d7b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:58.097827 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:08:58.106508 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-324f2faa-bce0-4fd6-8982-432eef030d7b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:58.107341 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-324f2faa-bce0-4fd6-8982-432eef030d7b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:58.108371 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-324f2faa-bce0-4fd6-8982-432eef030d7b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:58.109052 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-324f2faa-bce0-4fd6-8982-432eef030d7b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:58.127557 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-d8497f9b-a93c-462d-9cdc-357544dde0bf tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:58.169158 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-d8497f9b-a93c-462d-9cdc-357544dde0bf tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1510 microversion: 2.1 time: 0.238146 Jul 13 21:08:58.185212 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 308/603] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:57 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1510 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:58.192670 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-273aaa55-eb0d-4eb6-b165-c6de069bc8eb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:58.193282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-273aaa55-eb0d-4eb6-b165-c6de069bc8eb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:58.204215 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-273aaa55-eb0d-4eb6-b165-c6de069bc8eb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:58.205615 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-273aaa55-eb0d-4eb6-b165-c6de069bc8eb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:58.206702 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-273aaa55-eb0d-4eb6-b165-c6de069bc8eb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:58.207312 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-273aaa55-eb0d-4eb6-b165-c6de069bc8eb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:58.310771 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-324f2faa-bce0-4fd6-8982-432eef030d7b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:58.357945 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-324f2faa-bce0-4fd6-8982-432eef030d7b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1723 microversion: 2.1 time: 0.267926 Jul 13 21:08:58.358545 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 296/604] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:58 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:58.405494 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-273aaa55-eb0d-4eb6-b165-c6de069bc8eb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:58.416640 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-273aaa55-eb0d-4eb6-b165-c6de069bc8eb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:58.418325 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-273aaa55-eb0d-4eb6-b165-c6de069bc8eb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:58.420054 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-273aaa55-eb0d-4eb6-b165-c6de069bc8eb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1739 microversion: 2.20 time: 0.233346 Jul 13 21:08:58.431577 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 309/605] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:58 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1739 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:08:59.192091 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-786cf628-08ea-4142-a931-073e52d1b995 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:59.192666 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-786cf628-08ea-4142-a931-073e52d1b995 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:59.199323 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-786cf628-08ea-4142-a931-073e52d1b995 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:59.199762 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-786cf628-08ea-4142-a931-073e52d1b995 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:59.200510 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-786cf628-08ea-4142-a931-073e52d1b995 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:59.200936 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-786cf628-08ea-4142-a931-073e52d1b995 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:59.325787 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-786cf628-08ea-4142-a931-073e52d1b995 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:59.333904 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-786cf628-08ea-4142-a931-073e52d1b995 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1510 microversion: 2.1 time: 0.146136 Jul 13 21:08:59.334456 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 297/606] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:59 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1510 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:59.376383 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c7da714a-e771-4bf6-b34f-a3a2b036c81b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:59.376981 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-c7da714a-e771-4bf6-b34f-a3a2b036c81b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:59.383861 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c7da714a-e771-4bf6-b34f-a3a2b036c81b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:59.384297 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c7da714a-e771-4bf6-b34f-a3a2b036c81b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:59.385044 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c7da714a-e771-4bf6-b34f-a3a2b036c81b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:59.385468 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c7da714a-e771-4bf6-b34f-a3a2b036c81b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:59.439004 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-353ddf86-979d-4e0d-b656-c810f3d93a71 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:08:59.439609 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-353ddf86-979d-4e0d-b656-c810f3d93a71 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:08:59.446435 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-353ddf86-979d-4e0d-b656-c810f3d93a71 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:59.446912 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-353ddf86-979d-4e0d-b656-c810f3d93a71 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:59.447674 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-353ddf86-979d-4e0d-b656-c810f3d93a71 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:08:59.448110 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-353ddf86-979d-4e0d-b656-c810f3d93a71 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:08:59.514917 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c7da714a-e771-4bf6-b34f-a3a2b036c81b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:59.523098 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-c7da714a-e771-4bf6-b34f-a3a2b036c81b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1723 microversion: 2.1 time: 0.150424 Jul 13 21:08:59.523986 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 310/607] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:08:59 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:08:59.574767 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-353ddf86-979d-4e0d-b656-c810f3d93a71 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:59.583459 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-353ddf86-979d-4e0d-b656-c810f3d93a71 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:59.584969 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-353ddf86-979d-4e0d-b656-c810f3d93a71 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:08:59.588482 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-353ddf86-979d-4e0d-b656-c810f3d93a71 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1739 microversion: 2.20 time: 0.153332 Jul 13 21:08:59.589031 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 298/608] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:08:59 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:09:00.350912 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-7054bed5-f7a7-40bc-8560-8f927a7e82f1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:00.351519 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-7054bed5-f7a7-40bc-8560-8f927a7e82f1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:00.357565 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7054bed5-f7a7-40bc-8560-8f927a7e82f1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:00.358013 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7054bed5-f7a7-40bc-8560-8f927a7e82f1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:00.358807 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7054bed5-f7a7-40bc-8560-8f927a7e82f1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:00.359241 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7054bed5-f7a7-40bc-8560-8f927a7e82f1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:00.486878 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-7054bed5-f7a7-40bc-8560-8f927a7e82f1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:00.494587 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-7054bed5-f7a7-40bc-8560-8f927a7e82f1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1510 microversion: 2.1 time: 0.147478 Jul 13 21:09:00.495172 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 311/609] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:00 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:00.539888 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-e903829b-14b1-4478-ba83-2d1f07046f8b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:00.540437 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-e903829b-14b1-4478-ba83-2d1f07046f8b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:00.546916 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e903829b-14b1-4478-ba83-2d1f07046f8b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:00.547368 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e903829b-14b1-4478-ba83-2d1f07046f8b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:00.548127 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e903829b-14b1-4478-ba83-2d1f07046f8b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:00.548565 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e903829b-14b1-4478-ba83-2d1f07046f8b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:00.607370 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-871972b6-ba0a-4d02-8b23-14f84be53622 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:00.608183 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-871972b6-ba0a-4d02-8b23-14f84be53622 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:00.615062 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-871972b6-ba0a-4d02-8b23-14f84be53622 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:00.615579 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-871972b6-ba0a-4d02-8b23-14f84be53622 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:00.616429 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-871972b6-ba0a-4d02-8b23-14f84be53622 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:00.616941 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-871972b6-ba0a-4d02-8b23-14f84be53622 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:00.679069 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-e903829b-14b1-4478-ba83-2d1f07046f8b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:00.687073 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-e903829b-14b1-4478-ba83-2d1f07046f8b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1723 microversion: 2.1 time: 0.150951 Jul 13 21:09:00.687643 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 299/610] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:00 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:00.744106 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-871972b6-ba0a-4d02-8b23-14f84be53622 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:00.752052 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-871972b6-ba0a-4d02-8b23-14f84be53622 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:00.753611 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-871972b6-ba0a-4d02-8b23-14f84be53622 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:00.754792 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-871972b6-ba0a-4d02-8b23-14f84be53622 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1739 microversion: 2.20 time: 0.151284 Jul 13 21:09:00.755355 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 312/611] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:00 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:01.512235 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-722e8ef2-c70d-40a6-ac22-79764b37407b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:01.512832 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-722e8ef2-c70d-40a6-ac22-79764b37407b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:01.519066 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-722e8ef2-c70d-40a6-ac22-79764b37407b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:01.519512 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-722e8ef2-c70d-40a6-ac22-79764b37407b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:01.520380 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-722e8ef2-c70d-40a6-ac22-79764b37407b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:01.521343 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-722e8ef2-c70d-40a6-ac22-79764b37407b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:01.646387 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-722e8ef2-c70d-40a6-ac22-79764b37407b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:01.654010 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-722e8ef2-c70d-40a6-ac22-79764b37407b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1510 microversion: 2.1 time: 0.145570 Jul 13 21:09:01.654579 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 300/612] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:01 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1510 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:01.704000 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-79f4e257-5072-46d1-b8cf-acc8a94f8a26 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:01.704602 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-79f4e257-5072-46d1-b8cf-acc8a94f8a26 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:01.710970 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-79f4e257-5072-46d1-b8cf-acc8a94f8a26 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:01.711412 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-79f4e257-5072-46d1-b8cf-acc8a94f8a26 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:01.712161 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-79f4e257-5072-46d1-b8cf-acc8a94f8a26 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:01.712588 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-79f4e257-5072-46d1-b8cf-acc8a94f8a26 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:01.774330 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b48450c0-da79-4bf4-a5a5-719ae64a69fa tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:01.775076 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b48450c0-da79-4bf4-a5a5-719ae64a69fa tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:01.781771 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b48450c0-da79-4bf4-a5a5-719ae64a69fa tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:01.782433 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b48450c0-da79-4bf4-a5a5-719ae64a69fa tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:01.783330 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b48450c0-da79-4bf4-a5a5-719ae64a69fa tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:01.783875 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b48450c0-da79-4bf4-a5a5-719ae64a69fa tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:01.844146 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-79f4e257-5072-46d1-b8cf-acc8a94f8a26 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:01.852206 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-79f4e257-5072-46d1-b8cf-acc8a94f8a26 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1723 microversion: 2.1 time: 0.151986 Jul 13 21:09:01.852886 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 313/613] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:01 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:01.914502 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b48450c0-da79-4bf4-a5a5-719ae64a69fa tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:01.917862 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=100 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:09:01.922963 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b48450c0-da79-4bf4-a5a5-719ae64a69fa tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:01.924462 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b48450c0-da79-4bf4-a5a5-719ae64a69fa tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:01.925609 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b48450c0-da79-4bf4-a5a5-719ae64a69fa tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1739 microversion: 2.20 time: 0.155567 Jul 13 21:09:01.926159 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 301/614] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:01 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:09:02.670183 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-eca1a1f9-db1c-4090-9545-3a20b4a014ed tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:02.670813 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-eca1a1f9-db1c-4090-9545-3a20b4a014ed tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:02.677002 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-eca1a1f9-db1c-4090-9545-3a20b4a014ed tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:02.677449 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-eca1a1f9-db1c-4090-9545-3a20b4a014ed tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:02.678203 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-eca1a1f9-db1c-4090-9545-3a20b4a014ed tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:02.678650 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-eca1a1f9-db1c-4090-9545-3a20b4a014ed tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:02.801435 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-eca1a1f9-db1c-4090-9545-3a20b4a014ed tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:02.808894 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-eca1a1f9-db1c-4090-9545-3a20b4a014ed tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1510 microversion: 2.1 time: 0.142501 Jul 13 21:09:02.809449 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 314/615] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:02 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1510 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:02.869012 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-651ecb4e-1fa1-47e3-89ac-15e4854facb0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:02.869610 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-651ecb4e-1fa1-47e3-89ac-15e4854facb0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:02.876424 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-651ecb4e-1fa1-47e3-89ac-15e4854facb0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:02.876921 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-651ecb4e-1fa1-47e3-89ac-15e4854facb0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:02.877671 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-651ecb4e-1fa1-47e3-89ac-15e4854facb0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:02.878111 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-651ecb4e-1fa1-47e3-89ac-15e4854facb0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:02.944746 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c07e1f7d-13a5-43c5-984b-47176ee64848 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:02.945265 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-c07e1f7d-13a5-43c5-984b-47176ee64848 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:02.951348 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c07e1f7d-13a5-43c5-984b-47176ee64848 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:02.951791 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c07e1f7d-13a5-43c5-984b-47176ee64848 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:02.952605 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c07e1f7d-13a5-43c5-984b-47176ee64848 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:02.953034 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c07e1f7d-13a5-43c5-984b-47176ee64848 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:03.009370 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-651ecb4e-1fa1-47e3-89ac-15e4854facb0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:03.017350 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-651ecb4e-1fa1-47e3-89ac-15e4854facb0 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1723 microversion: 2.1 time: 0.152127 Jul 13 21:09:03.018194 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 302/616] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:02 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:03.078998 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c07e1f7d-13a5-43c5-984b-47176ee64848 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:03.087400 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c07e1f7d-13a5-43c5-984b-47176ee64848 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:03.089063 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c07e1f7d-13a5-43c5-984b-47176ee64848 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:03.090558 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-c07e1f7d-13a5-43c5-984b-47176ee64848 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1739 microversion: 2.20 time: 0.149765 Jul 13 21:09:03.091000 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 315/617] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:02 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1739 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:09:03.826291 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-78dec421-d940-4ad2-ae29-6e73947c695e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:03.827068 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-78dec421-d940-4ad2-ae29-6e73947c695e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:03.833837 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-78dec421-d940-4ad2-ae29-6e73947c695e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:03.834279 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-78dec421-d940-4ad2-ae29-6e73947c695e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:03.835174 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-78dec421-d940-4ad2-ae29-6e73947c695e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:03.835704 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-78dec421-d940-4ad2-ae29-6e73947c695e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:03.962059 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-78dec421-d940-4ad2-ae29-6e73947c695e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:03.969322 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-78dec421-d940-4ad2-ae29-6e73947c695e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1510 microversion: 2.1 time: 0.146908 Jul 13 21:09:03.969874 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 303/618] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:03 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:04.035120 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-d6baf84e-5096-4488-bc19-2e0edc020d47 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:04.035727 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-d6baf84e-5096-4488-bc19-2e0edc020d47 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:04.042300 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d6baf84e-5096-4488-bc19-2e0edc020d47 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:04.042779 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d6baf84e-5096-4488-bc19-2e0edc020d47 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:04.043542 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d6baf84e-5096-4488-bc19-2e0edc020d47 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:04.043976 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d6baf84e-5096-4488-bc19-2e0edc020d47 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:04.109918 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-d5cb9a88-d854-4e8f-95ab-6d15471ce14d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:04.110519 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-d5cb9a88-d854-4e8f-95ab-6d15471ce14d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:04.116901 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d5cb9a88-d854-4e8f-95ab-6d15471ce14d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:04.117345 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d5cb9a88-d854-4e8f-95ab-6d15471ce14d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:04.118088 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d5cb9a88-d854-4e8f-95ab-6d15471ce14d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:04.118518 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d5cb9a88-d854-4e8f-95ab-6d15471ce14d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:04.182596 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-d6baf84e-5096-4488-bc19-2e0edc020d47 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:04.191436 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-d6baf84e-5096-4488-bc19-2e0edc020d47 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1723 microversion: 2.1 time: 0.160006 Jul 13 21:09:04.192005 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 316/619] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:04 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:04.250505 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-d5cb9a88-d854-4e8f-95ab-6d15471ce14d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:04.258491 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-d5cb9a88-d854-4e8f-95ab-6d15471ce14d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:04.260011 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-d5cb9a88-d854-4e8f-95ab-6d15471ce14d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:04.261159 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-d5cb9a88-d854-4e8f-95ab-6d15471ce14d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1739 microversion: 2.20 time: 0.155273 Jul 13 21:09:04.261710 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 304/620] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:04 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:04.963071 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-8aae1dbe-d3fd-4daa-8f34-8cc2f0c851d9 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-95262676", "imageRef": "5a995c88-d784-4a51-a6b9-25aa9dfe607c", "flavorRef": "452", "networks": [{"uuid": "4ccee2ee-7321-412b-b2ec-e81fd12a0d90"}]}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:09:04.986456 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-4abb2e69-634a-4037-b8dc-c684fd9906cb tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:04.987309 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-4abb2e69-634a-4037-b8dc-c684fd9906cb tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:04.993626 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4abb2e69-634a-4037-b8dc-c684fd9906cb tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:04.994075 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4abb2e69-634a-4037-b8dc-c684fd9906cb tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:04.994858 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4abb2e69-634a-4037-b8dc-c684fd9906cb tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:04.995289 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4abb2e69-634a-4037-b8dc-c684fd9906cb tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:05.013377 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.network.neutron [None req-8aae1dbe-d3fd-4daa-8f34-8cc2f0c851d9 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] validate_networks() for [('4ccee2ee-7321-412b-b2ec-e81fd12a0d90', None, None, None, None, None)] {{(pid=118445) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 21:09:05.131817 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-4abb2e69-634a-4037-b8dc-c684fd9906cb tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:05.139495 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-4abb2e69-634a-4037-b8dc-c684fd9906cb tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1516 microversion: 2.1 time: 0.156721 Jul 13 21:09:05.140167 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 305/621] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:04 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:09:05.209774 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-70c22611-8a3d-41e3-9c09-f297031d47cb tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:05.210646 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-70c22611-8a3d-41e3-9c09-f297031d47cb tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:05.216619 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-70c22611-8a3d-41e3-9c09-f297031d47cb tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:05.217072 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-70c22611-8a3d-41e3-9c09-f297031d47cb tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:05.217840 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-70c22611-8a3d-41e3-9c09-f297031d47cb tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:05.218278 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-70c22611-8a3d-41e3-9c09-f297031d47cb tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:05.366185 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-70c22611-8a3d-41e3-9c09-f297031d47cb tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:05.374735 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-70c22611-8a3d-41e3-9c09-f297031d47cb tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1700 microversion: 2.1 time: 0.169132 Jul 13 21:09:05.375220 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 306/622] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:05 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1700 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:09:05.381149 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-75447fb5-ea3a-4e19-9c55-d84a53dd3d98 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:05.381736 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-75447fb5-ea3a-4e19-9c55-d84a53dd3d98 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:05.387677 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-75447fb5-ea3a-4e19-9c55-d84a53dd3d98 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:05.388199 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-75447fb5-ea3a-4e19-9c55-d84a53dd3d98 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:05.389025 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-75447fb5-ea3a-4e19-9c55-d84a53dd3d98 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:05.389517 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-75447fb5-ea3a-4e19-9c55-d84a53dd3d98 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:05.393619 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-8aae1dbe-d3fd-4daa-8f34-8cc2f0c851d9 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Flavor limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 21:09:05.394086 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-8aae1dbe-d3fd-4daa-8f34-8cc2f0c851d9 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Image limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 21:09:05.394372 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-8aae1dbe-d3fd-4daa-8f34-8cc2f0c851d9 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Flavor pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 21:09:05.394819 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-8aae1dbe-d3fd-4daa-8f34-8cc2f0c851d9 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Image pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 21:09:05.395227 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-8aae1dbe-d3fd-4daa-8f34-8cc2f0c851d9 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 21:09:05.417416 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8aae1dbe-d3fd-4daa-8f34-8cc2f0c851d9 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:05.418077 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8aae1dbe-d3fd-4daa-8f34-8cc2f0c851d9 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:05.419381 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8aae1dbe-d3fd-4daa-8f34-8cc2f0c851d9 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:05.419994 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8aae1dbe-d3fd-4daa-8f34-8cc2f0c851d9 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:05.452215 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-8aae1dbe-d3fd-4daa-8f34-8cc2f0c851d9 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Getting quotas for project 2332a661874a4a2faebb32a154be663c. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:09:05.456695 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-8aae1dbe-d3fd-4daa-8f34-8cc2f0c851d9 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Getting quotas for user c9074c8e166b4cd2a3cff41f0ccca273 and project 2332a661874a4a2faebb32a154be663c. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:09:05.469253 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8aae1dbe-d3fd-4daa-8f34-8cc2f0c851d9 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Going to run 1 instances... {{(pid=118445) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 21:09:05.471619 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8aae1dbe-d3fd-4daa-8f34-8cc2f0c851d9 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: 8e9318b8-72a2-4ff2-bd83-00cffd180921] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995c88-d784-4a51-a6b9-25aa9dfe607c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118445) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 21:09:05.521260 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-8aae1dbe-d3fd-4daa-8f34-8cc2f0c851d9 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.561485 Jul 13 21:09:05.522213 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 317/623] 10.222.0.39 () {60 vars in 1146 bytes} [Wed Jul 13 21:09:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 21:09:05.526920 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-a3d21469-6eb4-4389-aa1b-bd3e373afead tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:09:05.532407 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-75447fb5-ea3a-4e19-9c55-d84a53dd3d98 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:05.533459 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a3d21469-6eb4-4389-aa1b-bd3e373afead tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:05.533919 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a3d21469-6eb4-4389-aa1b-bd3e373afead tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:05.540644 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-75447fb5-ea3a-4e19-9c55-d84a53dd3d98 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:05.542151 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-75447fb5-ea3a-4e19-9c55-d84a53dd3d98 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:05.543336 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-75447fb5-ea3a-4e19-9c55-d84a53dd3d98 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1739 microversion: 2.20 time: 0.167213 Jul 13 21:09:05.543894 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 307/624] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:05 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:05.548356 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-bcd3d35c-8c96-49cd-903e-381772721d95 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:05.548960 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-bcd3d35c-8c96-49cd-903e-381772721d95 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: 8e9318b8-72a2-4ff2-bd83-00cffd180921] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:05.596980 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-a3d21469-6eb4-4389-aa1b-bd3e373afead tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Going to try to start instance {{(pid=118445) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 13 21:09:05.601133 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-bcd3d35c-8c96-49cd-903e-381772721d95 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:05.608065 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-bcd3d35c-8c96-49cd-903e-381772721d95 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921" status: 200 len: 1217 microversion: 2.1 time: 0.063044 Jul 13 21:09:05.608654 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 308/625] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:05 2022] GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921 => generated 1217 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:05.643882 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-a3d21469-6eb4-4389-aa1b-bd3e373afead tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "POST /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153/action" status: 202 len: 0 microversion: 2.1 time: 0.120626 Jul 13 21:09:05.644482 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 318/626] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Jul 13 21:09:05 2022] POST /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 21:09:05.652711 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-eff3be36-7c92-47d1-890e-ded636edd905 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:05.653324 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-eff3be36-7c92-47d1-890e-ded636edd905 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:05.659413 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eff3be36-7c92-47d1-890e-ded636edd905 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:05.659866 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eff3be36-7c92-47d1-890e-ded636edd905 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:05.660631 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eff3be36-7c92-47d1-890e-ded636edd905 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:05.661069 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eff3be36-7c92-47d1-890e-ded636edd905 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:05.796028 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-eff3be36-7c92-47d1-890e-ded636edd905 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:05.805318 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-eff3be36-7c92-47d1-890e-ded636edd905 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1709 microversion: 2.1 time: 0.156442 Jul 13 21:09:05.806032 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 309/627] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:05 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1709 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:06.513814 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c93a5e99-eb64-4974-8370-b8d48a3932f9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Action: 'create', calling method: .version_select at 0x7f96e86fdb80>, body: {"keypair": {"name": "tempest-keypair-1216158299", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjzNfsr8W701eYkan5YNI//TDYau2DNYCPu2A8w44kN/Qmk6Ih5xcamlaeR1pMk0BKqND/1so5tRUKJQEcp/jrXeAeFHw27H/TtRkBrJz4kYc3PrMIbdGAKSVNWIYjFtQ=="}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:09:06.529001 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-c93a5e99-eb64-4974-8370-b8d48a3932f9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Getting quotas for project c1d4119a1d0b474fb568818f1aaa933b. Resources: {'key_pairs'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:09:06.532792 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-c93a5e99-eb64-4974-8370-b8d48a3932f9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Getting quotas for user dc40c07fceab4a83ba9324da868034aa and project c1d4119a1d0b474fb568818f1aaa933b. Resources: {'key_pairs'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:09:06.554262 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-c93a5e99-eb64-4974-8370-b8d48a3932f9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044582 Jul 13 21:09:06.554867 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 319/628] 10.222.0.39 () {60 vars in 1158 bytes} [Wed Jul 13 21:09:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:09:06.562112 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-80a7ac00-8e8a-4937-8ae2-42683fcf8cd0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:06.562804 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-80a7ac00-8e8a-4937-8ae2-42683fcf8cd0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:06.569689 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-80a7ac00-8e8a-4937-8ae2-42683fcf8cd0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:06.570255 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-80a7ac00-8e8a-4937-8ae2-42683fcf8cd0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:06.571047 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-80a7ac00-8e8a-4937-8ae2-42683fcf8cd0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:06.571482 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-80a7ac00-8e8a-4937-8ae2-42683fcf8cd0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:06.628714 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ff843b1e-9dc9-413d-8f68-542484af4f90 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:06.629649 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ff843b1e-9dc9-413d-8f68-542484af4f90 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: 8e9318b8-72a2-4ff2-bd83-00cffd180921] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:06.637357 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ff843b1e-9dc9-413d-8f68-542484af4f90 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:06.637898 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ff843b1e-9dc9-413d-8f68-542484af4f90 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:06.638953 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ff843b1e-9dc9-413d-8f68-542484af4f90 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:06.639553 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ff843b1e-9dc9-413d-8f68-542484af4f90 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:06.646790 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:09:06.732501 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ff843b1e-9dc9-413d-8f68-542484af4f90 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:06.745519 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ff843b1e-9dc9-413d-8f68-542484af4f90 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921" status: 200 len: 1269 microversion: 2.1 time: 0.123464 Jul 13 21:09:06.747042 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 320/629] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:06 2022] GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921 => generated 1269 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:09:06.825742 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-46d2beb8-97a0-4e3e-ad92-8405d35cd503 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:06.827190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-46d2beb8-97a0-4e3e-ad92-8405d35cd503 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:06.830048 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-80a7ac00-8e8a-4937-8ae2-42683fcf8cd0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:06.836335 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-46d2beb8-97a0-4e3e-ad92-8405d35cd503 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:06.837070 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-46d2beb8-97a0-4e3e-ad92-8405d35cd503 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:06.838190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-46d2beb8-97a0-4e3e-ad92-8405d35cd503 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:06.838723 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-80a7ac00-8e8a-4937-8ae2-42683fcf8cd0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:06.839135 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-46d2beb8-97a0-4e3e-ad92-8405d35cd503 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:06.840232 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-80a7ac00-8e8a-4937-8ae2-42683fcf8cd0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:06.841398 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-80a7ac00-8e8a-4937-8ae2-42683fcf8cd0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1721 microversion: 2.20 time: 0.283179 Jul 13 21:09:06.863187 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 310/630] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:06 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1721 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:07.067298 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-46d2beb8-97a0-4e3e-ad92-8405d35cd503 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:07.076628 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-46d2beb8-97a0-4e3e-ad92-8405d35cd503 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1709 microversion: 2.1 time: 0.255687 Jul 13 21:09:07.077296 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 321/631] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:06 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1709 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:09:07.763087 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-6d976268-5845-4a5e-9a4c-d868b225855a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:07.763712 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-6d976268-5845-4a5e-9a4c-d868b225855a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: 8e9318b8-72a2-4ff2-bd83-00cffd180921] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:07.771013 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6d976268-5845-4a5e-9a4c-d868b225855a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:07.771467 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6d976268-5845-4a5e-9a4c-d868b225855a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:07.772221 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6d976268-5845-4a5e-9a4c-d868b225855a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:07.772724 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6d976268-5845-4a5e-9a4c-d868b225855a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:07.833535 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-6d976268-5845-4a5e-9a4c-d868b225855a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:07.840999 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-6d976268-5845-4a5e-9a4c-d868b225855a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921" status: 200 len: 1275 microversion: 2.1 time: 0.081769 Jul 13 21:09:07.841758 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 311/632] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:07 2022] GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921 => generated 1275 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:07.865307 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-9caeaa4a-fb30-43ac-a9bd-7484a05dfeb7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:07.865899 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-9caeaa4a-fb30-43ac-a9bd-7484a05dfeb7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:07.872422 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9caeaa4a-fb30-43ac-a9bd-7484a05dfeb7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:07.872863 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9caeaa4a-fb30-43ac-a9bd-7484a05dfeb7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:07.873821 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9caeaa4a-fb30-43ac-a9bd-7484a05dfeb7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:07.874259 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9caeaa4a-fb30-43ac-a9bd-7484a05dfeb7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:08.094842 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ac9c5af7-0f66-419f-9052-41038ffe6e5f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:08.095534 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-ac9c5af7-0f66-419f-9052-41038ffe6e5f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:08.101632 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ac9c5af7-0f66-419f-9052-41038ffe6e5f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:08.102120 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ac9c5af7-0f66-419f-9052-41038ffe6e5f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:08.103098 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ac9c5af7-0f66-419f-9052-41038ffe6e5f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:08.103602 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ac9c5af7-0f66-419f-9052-41038ffe6e5f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:08.193505 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-9caeaa4a-fb30-43ac-a9bd-7484a05dfeb7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:08.202376 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-9caeaa4a-fb30-43ac-a9bd-7484a05dfeb7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:08.203915 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-9caeaa4a-fb30-43ac-a9bd-7484a05dfeb7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:08.205080 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-9caeaa4a-fb30-43ac-a9bd-7484a05dfeb7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1721 microversion: 2.20 time: 0.344084 Jul 13 21:09:08.205638 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 322/633] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:07 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1721 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:08.248896 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ac9c5af7-0f66-419f-9052-41038ffe6e5f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:08.257527 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ac9c5af7-0f66-419f-9052-41038ffe6e5f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1709 microversion: 2.1 time: 0.166522 Jul 13 21:09:08.258095 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 312/634] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:08 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1709 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:08.503020 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-0d4fe833-aa41-4892-a98e-de22a21a1963 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1705010455", "imageRef": "5a995c88-d784-4a51-a6b9-25aa9dfe607c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b80b70e-3a69-4199-b81e-844abcd74aae"}], "security_groups": [{"name": "tempest-securitygroup--1469303736"}], "key_name": "tempest-keypair-1216158299", "user_data": "}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:09:08.568048 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-da9b97d5-ba7b-4a82-9e6b-3f8a8236eae5 req-7f161281-9da3-4589-b871-fda2aa0e27de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12316d28-2975-4c1e-b05b-82a3253bb35f", "name": "network-vif-unplugged", "status": "completed", "tag": "8d927002-4a46-4df8-b48a-c6cb84decd8d"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:09:08.576959 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-da9b97d5-ba7b-4a82-9e6b-3f8a8236eae5 req-7f161281-9da3-4589-b871-fda2aa0e27de service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:08.577510 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-da9b97d5-ba7b-4a82-9e6b-3f8a8236eae5 req-7f161281-9da3-4589-b871-fda2aa0e27de service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:08.589151 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-da9b97d5-ba7b-4a82-9e6b-3f8a8236eae5 req-7f161281-9da3-4589-b871-fda2aa0e27de service nova] Creating event network-vif-unplugged:8d927002-4a46-4df8-b48a-c6cb84decd8d for instance 12316d28-2975-4c1e-b05b-82a3253bb35f on hv-cinder-79987 Jul 13 21:09:08.594268 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-da9b97d5-ba7b-4a82-9e6b-3f8a8236eae5 req-7f161281-9da3-4589-b871-fda2aa0e27de service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030670 Jul 13 21:09:08.594893 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 313/635] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:09:08.607364 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.network.neutron [None req-0d4fe833-aa41-4892-a98e-de22a21a1963 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] validate_networks() for [('4b80b70e-3a69-4199-b81e-844abcd74aae', None, None, None, None, None)] {{(pid=118445) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 21:09:08.858871 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-f5c593dd-3370-4972-9c09-0e5c114cc95c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:08.859561 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-f5c593dd-3370-4972-9c09-0e5c114cc95c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: 8e9318b8-72a2-4ff2-bd83-00cffd180921] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:08.866738 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f5c593dd-3370-4972-9c09-0e5c114cc95c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:08.867176 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f5c593dd-3370-4972-9c09-0e5c114cc95c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:08.867931 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f5c593dd-3370-4972-9c09-0e5c114cc95c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:08.868360 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f5c593dd-3370-4972-9c09-0e5c114cc95c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:08.986179 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-0d4fe833-aa41-4892-a98e-de22a21a1963 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Flavor limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 21:09:08.986681 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-0d4fe833-aa41-4892-a98e-de22a21a1963 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Image limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 21:09:08.987207 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-0d4fe833-aa41-4892-a98e-de22a21a1963 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Flavor pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 21:09:08.987615 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-0d4fe833-aa41-4892-a98e-de22a21a1963 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Image pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 21:09:08.988024 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-0d4fe833-aa41-4892-a98e-de22a21a1963 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 21:09:08.996748 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f5c593dd-3370-4972-9c09-0e5c114cc95c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:08.997914 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0d4fe833-aa41-4892-a98e-de22a21a1963 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:08.998544 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0d4fe833-aa41-4892-a98e-de22a21a1963 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:08.999368 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0d4fe833-aa41-4892-a98e-de22a21a1963 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:08.999984 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0d4fe833-aa41-4892-a98e-de22a21a1963 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:09.005098 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-f5c593dd-3370-4972-9c09-0e5c114cc95c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921" status: 200 len: 1317 microversion: 2.1 time: 0.150333 Jul 13 21:09:09.005907 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 314/636] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:08 2022] GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:09:09.017993 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-0d4fe833-aa41-4892-a98e-de22a21a1963 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Getting quotas for project c1d4119a1d0b474fb568818f1aaa933b. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:09:09.022224 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-0d4fe833-aa41-4892-a98e-de22a21a1963 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Getting quotas for user dc40c07fceab4a83ba9324da868034aa and project c1d4119a1d0b474fb568818f1aaa933b. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:09:09.033178 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-0d4fe833-aa41-4892-a98e-de22a21a1963 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Going to run 1 instances... {{(pid=118445) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 21:09:09.035557 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-0d4fe833-aa41-4892-a98e-de22a21a1963 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995c88-d784-4a51-a6b9-25aa9dfe607c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118445) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 21:09:09.088371 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-0d4fe833-aa41-4892-a98e-de22a21a1963 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.589554 Jul 13 21:09:09.089332 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 323/637] 10.222.0.39 () {60 vars in 1146 bytes} [Wed Jul 13 21:09:08 2022] POST /compute/v2.1/servers => generated 409 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 21:09:09.099511 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-dc55c42a-ba9e-4942-b1e7-e88bb2a97db5 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:09.100121 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-dc55c42a-ba9e-4942-b1e7-e88bb2a97db5 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:09.156988 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-dc55c42a-ba9e-4942-b1e7-e88bb2a97db5 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:09.165194 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-dc55c42a-ba9e-4942-b1e7-e88bb2a97db5 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1246 microversion: 2.1 time: 0.069932 Jul 13 21:09:09.166227 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 315/638] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:09 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1246 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:09.227274 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-b2f64741-097e-4760-abd5-4d5613cecc7d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:09.228756 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-b2f64741-097e-4760-abd5-4d5613cecc7d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:09.236061 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b2f64741-097e-4760-abd5-4d5613cecc7d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:09.236791 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b2f64741-097e-4760-abd5-4d5613cecc7d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:09.237798 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b2f64741-097e-4760-abd5-4d5613cecc7d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:09.238796 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b2f64741-097e-4760-abd5-4d5613cecc7d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:09.275036 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-aeb1a9b5-7c99-4cd7-9bef-24304b937f05 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:09.275651 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-aeb1a9b5-7c99-4cd7-9bef-24304b937f05 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:09.282075 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-aeb1a9b5-7c99-4cd7-9bef-24304b937f05 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:09.282802 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-aeb1a9b5-7c99-4cd7-9bef-24304b937f05 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:09.283561 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-aeb1a9b5-7c99-4cd7-9bef-24304b937f05 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:09.283997 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-aeb1a9b5-7c99-4cd7-9bef-24304b937f05 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:09.456221 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-aeb1a9b5-7c99-4cd7-9bef-24304b937f05 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:09.467166 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-aeb1a9b5-7c99-4cd7-9bef-24304b937f05 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1709 microversion: 2.1 time: 0.196591 Jul 13 21:09:09.467756 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 316/639] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:09 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1709 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:09.536537 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b2f64741-097e-4760-abd5-4d5613cecc7d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:09.545055 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b2f64741-097e-4760-abd5-4d5613cecc7d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:09.546680 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b2f64741-097e-4760-abd5-4d5613cecc7d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:09.547941 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-b2f64741-097e-4760-abd5-4d5613cecc7d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1721 microversion: 2.20 time: 0.326796 Jul 13 21:09:09.548491 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 324/640] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:09 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1721 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:09.941617 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-d32afba6-3fd8-49ad-8dfc-4075d2ef3eaf req-f603b67c-a2b2-4301-85d3-64650152c741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e9318b8-72a2-4ff2-bd83-00cffd180921", "tag": "3dd595db-0847-4e1d-91fd-0fa7b77936d6"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:09:09.951346 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-d32afba6-3fd8-49ad-8dfc-4075d2ef3eaf req-f603b67c-a2b2-4301-85d3-64650152c741 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:09.951707 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-d32afba6-3fd8-49ad-8dfc-4075d2ef3eaf req-f603b67c-a2b2-4301-85d3-64650152c741 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:09.962521 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-d32afba6-3fd8-49ad-8dfc-4075d2ef3eaf req-f603b67c-a2b2-4301-85d3-64650152c741 service nova] Creating event network-changed:3dd595db-0847-4e1d-91fd-0fa7b77936d6 for instance 8e9318b8-72a2-4ff2-bd83-00cffd180921 on hv-cinder-79987 Jul 13 21:09:09.966976 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-d32afba6-3fd8-49ad-8dfc-4075d2ef3eaf req-f603b67c-a2b2-4301-85d3-64650152c741 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029010 Jul 13 21:09:09.967553 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 317/641] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:09:10.022457 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-a1a67fcb-6381-4f1f-852b-ddd5d42cd42c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:10.023080 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-a1a67fcb-6381-4f1f-852b-ddd5d42cd42c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: 8e9318b8-72a2-4ff2-bd83-00cffd180921] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:10.029434 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a1a67fcb-6381-4f1f-852b-ddd5d42cd42c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:10.029876 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a1a67fcb-6381-4f1f-852b-ddd5d42cd42c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:10.030638 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a1a67fcb-6381-4f1f-852b-ddd5d42cd42c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:10.031079 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a1a67fcb-6381-4f1f-852b-ddd5d42cd42c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:10.164575 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-a1a67fcb-6381-4f1f-852b-ddd5d42cd42c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:10.172116 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-a1a67fcb-6381-4f1f-852b-ddd5d42cd42c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921" status: 200 len: 1317 microversion: 2.1 time: 0.153745 Jul 13 21:09:10.172687 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 325/642] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:10 2022] GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:10.183769 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-31afa23e-530a-4299-9e03-5fcac945189a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:10.184525 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-31afa23e-530a-4299-9e03-5fcac945189a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:10.191525 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-31afa23e-530a-4299-9e03-5fcac945189a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:10.191983 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-31afa23e-530a-4299-9e03-5fcac945189a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:10.193346 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-31afa23e-530a-4299-9e03-5fcac945189a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:10.193788 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-31afa23e-530a-4299-9e03-5fcac945189a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:10.263504 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-31afa23e-530a-4299-9e03-5fcac945189a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:10.276624 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-31afa23e-530a-4299-9e03-5fcac945189a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1242 microversion: 2.1 time: 0.095310 Jul 13 21:09:10.277980 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 318/643] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:10 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1242 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:10.484566 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-2bdeb110-93bd-4d8e-a44d-77e98bbf0973 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:10.485162 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-2bdeb110-93bd-4d8e-a44d-77e98bbf0973 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:10.491851 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2bdeb110-93bd-4d8e-a44d-77e98bbf0973 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:10.492293 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2bdeb110-93bd-4d8e-a44d-77e98bbf0973 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:10.493053 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2bdeb110-93bd-4d8e-a44d-77e98bbf0973 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:10.493481 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2bdeb110-93bd-4d8e-a44d-77e98bbf0973 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:10.566253 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-4301071d-6d4a-4c61-b45a-01d22d755dbf tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:10.566800 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-4301071d-6d4a-4c61-b45a-01d22d755dbf tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:10.572923 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4301071d-6d4a-4c61-b45a-01d22d755dbf tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:10.573369 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4301071d-6d4a-4c61-b45a-01d22d755dbf tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:10.574124 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4301071d-6d4a-4c61-b45a-01d22d755dbf tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:10.574641 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4301071d-6d4a-4c61-b45a-01d22d755dbf tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:10.626050 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-2bdeb110-93bd-4d8e-a44d-77e98bbf0973 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:10.633994 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-2bdeb110-93bd-4d8e-a44d-77e98bbf0973 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1713 microversion: 2.1 time: 0.153234 Jul 13 21:09:10.634834 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 326/644] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:10 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1713 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:10.703277 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-4301071d-6d4a-4c61-b45a-01d22d755dbf tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:10.711476 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-4301071d-6d4a-4c61-b45a-01d22d755dbf tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:10.712964 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-4301071d-6d4a-4c61-b45a-01d22d755dbf tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:10.714088 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-4301071d-6d4a-4c61-b45a-01d22d755dbf tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1664 microversion: 2.20 time: 0.151792 Jul 13 21:09:10.714653 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 319/645] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:10 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1664 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:09:10.731972 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c308b228-1b3c-4b09-82a2-5b81c581c1cb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8b1464c-146a-4fd3-b394-795f5011e0dc"}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:09:10.733076 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-c308b228-1b3c-4b09-82a2-5b81c581c1cb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:10.739008 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c308b228-1b3c-4b09-82a2-5b81c581c1cb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:10.739486 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c308b228-1b3c-4b09-82a2-5b81c581c1cb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:10.740260 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c308b228-1b3c-4b09-82a2-5b81c581c1cb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:10.740684 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c308b228-1b3c-4b09-82a2-5b81c581c1cb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:11.086279 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-c308b228-1b3c-4b09-82a2-5b81c581c1cb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "POST /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.358100 Jul 13 21:09:11.087087 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 327/646] 10.222.0.39 () {62 vars in 1363 bytes} [Wed Jul 13 21:09:10 2022] POST /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f/os-volume_attachments => generated 188 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 21:09:11.189021 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-86e1b07c-1eb0-427e-9a37-3e7728a824fc tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:11.189618 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-86e1b07c-1eb0-427e-9a37-3e7728a824fc tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: 8e9318b8-72a2-4ff2-bd83-00cffd180921] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:11.196620 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-86e1b07c-1eb0-427e-9a37-3e7728a824fc tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:11.197067 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-86e1b07c-1eb0-427e-9a37-3e7728a824fc tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:11.197819 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-86e1b07c-1eb0-427e-9a37-3e7728a824fc tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:11.198249 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-86e1b07c-1eb0-427e-9a37-3e7728a824fc tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:11.198558 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-5e3fdfe8-0cf5-49c0-bb5e-13a12bbb08c9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:09:11.199153 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-5e3fdfe8-0cf5-49c0-bb5e-13a12bbb08c9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:11.205517 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5e3fdfe8-0cf5-49c0-bb5e-13a12bbb08c9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:11.205945 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5e3fdfe8-0cf5-49c0-bb5e-13a12bbb08c9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:11.206723 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5e3fdfe8-0cf5-49c0-bb5e-13a12bbb08c9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:11.207160 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5e3fdfe8-0cf5-49c0-bb5e-13a12bbb08c9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:11.335426 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-5e3fdfe8-0cf5-49c0-bb5e-13a12bbb08c9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "POST /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f/action" status: 202 len: 0 microversion: 2.20 time: 0.140915 Jul 13 21:09:11.336393 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 328/647] 10.222.0.39 () {62 vars in 1318 bytes} [Wed Jul 13 21:09:11 2022] POST /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 13 21:09:11.341229 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-00a16d64-417d-430b-b34d-59e355b5f5f7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:11.341835 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-00a16d64-417d-430b-b34d-59e355b5f5f7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:11.348397 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-00a16d64-417d-430b-b34d-59e355b5f5f7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:11.349023 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-00a16d64-417d-430b-b34d-59e355b5f5f7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:11.349796 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-00a16d64-417d-430b-b34d-59e355b5f5f7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:11.350464 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-00a16d64-417d-430b-b34d-59e355b5f5f7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:11.372013 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-86e1b07c-1eb0-427e-9a37-3e7728a824fc tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:11.416824 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-86e1b07c-1eb0-427e-9a37-3e7728a824fc tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921" status: 200 len: 1317 microversion: 2.1 time: 0.228938 Jul 13 21:09:11.417190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-00a16d64-417d-430b-b34d-59e355b5f5f7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:11.418591 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 320/648] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:11 2022] GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:11.423230 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0f90e791-3f0c-4d46-a681-5833e55fc2d6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:11.429930 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-0f90e791-3f0c-4d46-a681-5833e55fc2d6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:11.430311 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-00a16d64-417d-430b-b34d-59e355b5f5f7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1306 microversion: 2.1 time: 0.092571 Jul 13 21:09:11.434165 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 329/649] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:11 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1306 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:11.443269 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0f90e791-3f0c-4d46-a681-5833e55fc2d6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:11.443720 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0f90e791-3f0c-4d46-a681-5833e55fc2d6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:11.447452 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0f90e791-3f0c-4d46-a681-5833e55fc2d6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:11.448230 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0f90e791-3f0c-4d46-a681-5833e55fc2d6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:11.925985 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-0f90e791-3f0c-4d46-a681-5833e55fc2d6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:11.930503 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=100 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:09:11.937966 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-0f90e791-3f0c-4d46-a681-5833e55fc2d6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:11.939609 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-0f90e791-3f0c-4d46-a681-5833e55fc2d6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:11.940914 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-0f90e791-3f0c-4d46-a681-5833e55fc2d6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1750 microversion: 2.20 time: 0.521355 Jul 13 21:09:11.942746 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 321/650] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:11 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1750 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:12.434995 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-8c10de0b-22c8-4dad-a6f8-711f8abee5c0 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:12.436310 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8c10de0b-22c8-4dad-a6f8-711f8abee5c0 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: 8e9318b8-72a2-4ff2-bd83-00cffd180921] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:12.444940 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8c10de0b-22c8-4dad-a6f8-711f8abee5c0 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:12.445390 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8c10de0b-22c8-4dad-a6f8-711f8abee5c0 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:12.446357 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8c10de0b-22c8-4dad-a6f8-711f8abee5c0 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:12.446822 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8c10de0b-22c8-4dad-a6f8-711f8abee5c0 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:12.448274 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-a95374d1-502b-4094-9bd8-d33cac7884ef tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:12.449290 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-a95374d1-502b-4094-9bd8-d33cac7884ef tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:12.455676 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a95374d1-502b-4094-9bd8-d33cac7884ef tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:12.459194 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a95374d1-502b-4094-9bd8-d33cac7884ef tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:12.463840 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a95374d1-502b-4094-9bd8-d33cac7884ef tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:12.464348 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a95374d1-502b-4094-9bd8-d33cac7884ef tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:12.631681 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8c10de0b-22c8-4dad-a6f8-711f8abee5c0 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:12.639999 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-8c10de0b-22c8-4dad-a6f8-711f8abee5c0 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921" status: 200 len: 1317 microversion: 2.1 time: 0.208918 Jul 13 21:09:12.640585 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 330/651] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:12 2022] GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:12.675989 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-a95374d1-502b-4094-9bd8-d33cac7884ef tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:12.683646 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-a95374d1-502b-4094-9bd8-d33cac7884ef tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1372 microversion: 2.1 time: 0.239349 Jul 13 21:09:12.684214 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 322/652] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:12 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1372 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:12.959298 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-cb2bd0d0-0f95-45ec-8fb8-b586088c3da4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:12.959834 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-cb2bd0d0-0f95-45ec-8fb8-b586088c3da4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:12.965811 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-cb2bd0d0-0f95-45ec-8fb8-b586088c3da4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:12.966258 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-cb2bd0d0-0f95-45ec-8fb8-b586088c3da4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:12.967050 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-cb2bd0d0-0f95-45ec-8fb8-b586088c3da4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:12.967516 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-cb2bd0d0-0f95-45ec-8fb8-b586088c3da4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:13.094249 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-cb2bd0d0-0f95-45ec-8fb8-b586088c3da4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:13.102854 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-cb2bd0d0-0f95-45ec-8fb8-b586088c3da4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:13.104451 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-cb2bd0d0-0f95-45ec-8fb8-b586088c3da4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:13.105563 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-cb2bd0d0-0f95-45ec-8fb8-b586088c3da4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1750 microversion: 2.20 time: 0.150151 Jul 13 21:09:13.106115 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 331/653] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:12 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1750 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:13.657382 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-36e2ce9f-5437-49c2-9bd0-e34e175a8ac3 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:13.657983 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-36e2ce9f-5437-49c2-9bd0-e34e175a8ac3 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: 8e9318b8-72a2-4ff2-bd83-00cffd180921] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:13.665079 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-36e2ce9f-5437-49c2-9bd0-e34e175a8ac3 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:13.665524 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-36e2ce9f-5437-49c2-9bd0-e34e175a8ac3 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:13.666273 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-36e2ce9f-5437-49c2-9bd0-e34e175a8ac3 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:13.666737 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-36e2ce9f-5437-49c2-9bd0-e34e175a8ac3 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:13.701142 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-11d4817f-22f6-469d-b988-00dc9a079acf tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:13.701741 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-11d4817f-22f6-469d-b988-00dc9a079acf tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:13.708845 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-11d4817f-22f6-469d-b988-00dc9a079acf tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:13.709286 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-11d4817f-22f6-469d-b988-00dc9a079acf tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:13.710070 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-11d4817f-22f6-469d-b988-00dc9a079acf tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:13.710499 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-11d4817f-22f6-469d-b988-00dc9a079acf tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:13.795703 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-36e2ce9f-5437-49c2-9bd0-e34e175a8ac3 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:13.803231 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-36e2ce9f-5437-49c2-9bd0-e34e175a8ac3 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921" status: 200 len: 1317 microversion: 2.1 time: 0.149634 Jul 13 21:09:13.803959 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 323/654] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:13 2022] GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:13.836827 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-11d4817f-22f6-469d-b988-00dc9a079acf tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:13.844145 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-11d4817f-22f6-469d-b988-00dc9a079acf tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1372 microversion: 2.1 time: 0.146769 Jul 13 21:09:13.844700 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 332/655] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:13 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:09:14.123441 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-a9d3bce9-b208-4ee3-9aba-1f2a92bdde5d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:14.124041 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-a9d3bce9-b208-4ee3-9aba-1f2a92bdde5d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:14.130394 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a9d3bce9-b208-4ee3-9aba-1f2a92bdde5d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:14.130874 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a9d3bce9-b208-4ee3-9aba-1f2a92bdde5d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:14.131623 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a9d3bce9-b208-4ee3-9aba-1f2a92bdde5d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:14.132052 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a9d3bce9-b208-4ee3-9aba-1f2a92bdde5d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:14.259539 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-a9d3bce9-b208-4ee3-9aba-1f2a92bdde5d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:14.268074 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-a9d3bce9-b208-4ee3-9aba-1f2a92bdde5d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:14.269557 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-a9d3bce9-b208-4ee3-9aba-1f2a92bdde5d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:14.270784 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-a9d3bce9-b208-4ee3-9aba-1f2a92bdde5d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1750 microversion: 2.20 time: 0.151146 Jul 13 21:09:14.271451 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 324/656] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:14 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1750 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:14.819422 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-5f418fc3-e200-46e1-ac43-aa8a5c82965d tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:14.820025 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-5f418fc3-e200-46e1-ac43-aa8a5c82965d tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: 8e9318b8-72a2-4ff2-bd83-00cffd180921] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:14.826430 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5f418fc3-e200-46e1-ac43-aa8a5c82965d tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:14.826906 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5f418fc3-e200-46e1-ac43-aa8a5c82965d tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:14.827666 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5f418fc3-e200-46e1-ac43-aa8a5c82965d tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:14.828098 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5f418fc3-e200-46e1-ac43-aa8a5c82965d tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:14.860955 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-6da82814-6d27-4d88-a8ad-06e2fdba03f7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:14.861548 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-6da82814-6d27-4d88-a8ad-06e2fdba03f7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:14.868688 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6da82814-6d27-4d88-a8ad-06e2fdba03f7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:14.869132 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6da82814-6d27-4d88-a8ad-06e2fdba03f7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:14.869888 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6da82814-6d27-4d88-a8ad-06e2fdba03f7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:14.870315 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6da82814-6d27-4d88-a8ad-06e2fdba03f7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:14.957480 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5f418fc3-e200-46e1-ac43-aa8a5c82965d tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:14.961124 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:09:14.965874 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-5f418fc3-e200-46e1-ac43-aa8a5c82965d tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921" status: 200 len: 1317 microversion: 2.1 time: 0.150228 Jul 13 21:09:14.966735 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 333/657] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:14 2022] GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:14.995701 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-6da82814-6d27-4d88-a8ad-06e2fdba03f7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:15.003352 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-6da82814-6d27-4d88-a8ad-06e2fdba03f7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1372 microversion: 2.1 time: 0.146078 Jul 13 21:09:15.003919 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 325/658] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:14 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1372 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:09:15.290330 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-032120eb-3015-4d32-a67c-368650a7288a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:15.291029 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-032120eb-3015-4d32-a67c-368650a7288a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:15.294469 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:09:15.302595 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-032120eb-3015-4d32-a67c-368650a7288a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:15.303223 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-032120eb-3015-4d32-a67c-368650a7288a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:15.304144 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-032120eb-3015-4d32-a67c-368650a7288a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:15.304776 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-032120eb-3015-4d32-a67c-368650a7288a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:15.433021 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-032120eb-3015-4d32-a67c-368650a7288a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:15.441387 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-032120eb-3015-4d32-a67c-368650a7288a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:15.443405 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-032120eb-3015-4d32-a67c-368650a7288a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:15.444568 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-032120eb-3015-4d32-a67c-368650a7288a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1752 microversion: 2.20 time: 0.159061 Jul 13 21:09:15.445117 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 334/659] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:15 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:15.752487 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-4b2327b3-d55d-4522-b104-5c949f41de02 req-5a5b39b0-e5c5-4224-af62-c75d77ac12a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84e5ee85-86cb-4ee9-9002-22ded6b91cdd", "tag": "b2e4f436-9a2c-40fa-b1c8-e749b75a70b9"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:09:15.765649 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-4b2327b3-d55d-4522-b104-5c949f41de02 req-5a5b39b0-e5c5-4224-af62-c75d77ac12a1 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:15.766254 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-4b2327b3-d55d-4522-b104-5c949f41de02 req-5a5b39b0-e5c5-4224-af62-c75d77ac12a1 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:15.778367 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-4b2327b3-d55d-4522-b104-5c949f41de02 req-5a5b39b0-e5c5-4224-af62-c75d77ac12a1 service nova] Creating event network-changed:b2e4f436-9a2c-40fa-b1c8-e749b75a70b9 for instance 84e5ee85-86cb-4ee9-9002-22ded6b91cdd on hv-cinder-79987 Jul 13 21:09:15.783546 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-4b2327b3-d55d-4522-b104-5c949f41de02 req-5a5b39b0-e5c5-4224-af62-c75d77ac12a1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036507 Jul 13 21:09:15.784213 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 326/660] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:09:15.983754 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c2b4e337-e3b0-4f2b-9dcc-678a7d8034b7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:15.984354 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-c2b4e337-e3b0-4f2b-9dcc-678a7d8034b7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: 8e9318b8-72a2-4ff2-bd83-00cffd180921] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:15.991808 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c2b4e337-e3b0-4f2b-9dcc-678a7d8034b7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:15.992254 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c2b4e337-e3b0-4f2b-9dcc-678a7d8034b7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:15.993024 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c2b4e337-e3b0-4f2b-9dcc-678a7d8034b7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:15.994268 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c2b4e337-e3b0-4f2b-9dcc-678a7d8034b7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:16.022276 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-7c80c33b-1b3d-4c51-a9d8-5feee67a2333 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:16.023015 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-7c80c33b-1b3d-4c51-a9d8-5feee67a2333 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:16.029562 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7c80c33b-1b3d-4c51-a9d8-5feee67a2333 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:16.030012 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7c80c33b-1b3d-4c51-a9d8-5feee67a2333 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:16.030839 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7c80c33b-1b3d-4c51-a9d8-5feee67a2333 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:16.031668 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7c80c33b-1b3d-4c51-a9d8-5feee67a2333 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:16.152652 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c2b4e337-e3b0-4f2b-9dcc-678a7d8034b7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:16.161909 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-c2b4e337-e3b0-4f2b-9dcc-678a7d8034b7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921" status: 200 len: 1317 microversion: 2.1 time: 0.182425 Jul 13 21:09:16.162566 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 335/661] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:15 2022] GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:16.239973 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-7c80c33b-1b3d-4c51-a9d8-5feee67a2333 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:16.247593 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-7c80c33b-1b3d-4c51-a9d8-5feee67a2333 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1372 microversion: 2.1 time: 0.230979 Jul 13 21:09:16.248170 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 327/662] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:16 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1372 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:09:16.463294 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-616ee303-b7f2-427d-b760-1e5a21f2ba9a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:16.463835 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-616ee303-b7f2-427d-b760-1e5a21f2ba9a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:16.469729 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-616ee303-b7f2-427d-b760-1e5a21f2ba9a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:16.470171 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-616ee303-b7f2-427d-b760-1e5a21f2ba9a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:16.470946 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-616ee303-b7f2-427d-b760-1e5a21f2ba9a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:16.471373 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-616ee303-b7f2-427d-b760-1e5a21f2ba9a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:16.597726 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-616ee303-b7f2-427d-b760-1e5a21f2ba9a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:16.606997 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-616ee303-b7f2-427d-b760-1e5a21f2ba9a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:16.608496 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-616ee303-b7f2-427d-b760-1e5a21f2ba9a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:16.609680 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-616ee303-b7f2-427d-b760-1e5a21f2ba9a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.150317 Jul 13 21:09:16.610547 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 336/663] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:16 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:17.178471 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-4d8b5d85-f878-4c49-9b98-c4f26b69f51b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:17.179111 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-4d8b5d85-f878-4c49-9b98-c4f26b69f51b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: 8e9318b8-72a2-4ff2-bd83-00cffd180921] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:17.185665 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4d8b5d85-f878-4c49-9b98-c4f26b69f51b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:17.186117 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4d8b5d85-f878-4c49-9b98-c4f26b69f51b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:17.186900 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4d8b5d85-f878-4c49-9b98-c4f26b69f51b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:17.187341 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4d8b5d85-f878-4c49-9b98-c4f26b69f51b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:17.265098 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-d92d8ae5-f460-4090-a3e4-118e6190262a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:17.265698 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-d92d8ae5-f460-4090-a3e4-118e6190262a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:17.273378 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d92d8ae5-f460-4090-a3e4-118e6190262a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:17.273951 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d92d8ae5-f460-4090-a3e4-118e6190262a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:17.274750 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d92d8ae5-f460-4090-a3e4-118e6190262a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:17.275177 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d92d8ae5-f460-4090-a3e4-118e6190262a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:17.315949 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-4d8b5d85-f878-4c49-9b98-c4f26b69f51b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:17.324073 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-4d8b5d85-f878-4c49-9b98-c4f26b69f51b tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921" status: 200 len: 1317 microversion: 2.1 time: 0.149424 Jul 13 21:09:17.326956 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 328/664] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:17 2022] GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:17.408960 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-d92d8ae5-f460-4090-a3e4-118e6190262a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:17.416731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-d92d8ae5-f460-4090-a3e4-118e6190262a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1372 microversion: 2.1 time: 0.155677 Jul 13 21:09:17.417294 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 337/665] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:17 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:09:17.628212 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-8c4b59ee-5e47-4829-92c2-9b7fb1408375 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:17.628834 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-8c4b59ee-5e47-4829-92c2-9b7fb1408375 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:17.635368 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8c4b59ee-5e47-4829-92c2-9b7fb1408375 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:17.635811 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8c4b59ee-5e47-4829-92c2-9b7fb1408375 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:17.636555 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8c4b59ee-5e47-4829-92c2-9b7fb1408375 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:17.636982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8c4b59ee-5e47-4829-92c2-9b7fb1408375 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:17.765414 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-8c4b59ee-5e47-4829-92c2-9b7fb1408375 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:17.774264 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-8c4b59ee-5e47-4829-92c2-9b7fb1408375 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:17.775780 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-8c4b59ee-5e47-4829-92c2-9b7fb1408375 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:17.776916 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-8c4b59ee-5e47-4829-92c2-9b7fb1408375 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.152918 Jul 13 21:09:17.777464 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 329/666] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:17 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:18.340714 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-d753ccf8-c033-4994-af51-c8221dc96f83 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:18.341316 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-d753ccf8-c033-4994-af51-c8221dc96f83 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: 8e9318b8-72a2-4ff2-bd83-00cffd180921] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:18.347743 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d753ccf8-c033-4994-af51-c8221dc96f83 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:18.348181 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d753ccf8-c033-4994-af51-c8221dc96f83 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:18.349539 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d753ccf8-c033-4994-af51-c8221dc96f83 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:18.349969 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d753ccf8-c033-4994-af51-c8221dc96f83 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:18.433363 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-e881be18-32cd-4c0d-a68f-cdb31d959abe tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:18.433960 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-e881be18-32cd-4c0d-a68f-cdb31d959abe tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:18.440689 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e881be18-32cd-4c0d-a68f-cdb31d959abe tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:18.441290 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e881be18-32cd-4c0d-a68f-cdb31d959abe tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:18.442668 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e881be18-32cd-4c0d-a68f-cdb31d959abe tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:18.443257 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e881be18-32cd-4c0d-a68f-cdb31d959abe tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:18.475723 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-d753ccf8-c033-4994-af51-c8221dc96f83 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:18.483278 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-d753ccf8-c033-4994-af51-c8221dc96f83 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921" status: 200 len: 1317 microversion: 2.1 time: 0.146442 Jul 13 21:09:18.483853 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 338/667] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:18 2022] GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921 => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:18.568746 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-e881be18-32cd-4c0d-a68f-cdb31d959abe tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:18.576080 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-e881be18-32cd-4c0d-a68f-cdb31d959abe tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1372 microversion: 2.1 time: 0.146700 Jul 13 21:09:18.576643 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 330/668] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:18 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:09:18.795442 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-8efe2c84-26f0-42cf-8b59-f2f6a92f573f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:18.796040 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8efe2c84-26f0-42cf-8b59-f2f6a92f573f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:18.801981 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8efe2c84-26f0-42cf-8b59-f2f6a92f573f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:18.802438 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8efe2c84-26f0-42cf-8b59-f2f6a92f573f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:18.803261 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8efe2c84-26f0-42cf-8b59-f2f6a92f573f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:18.803694 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8efe2c84-26f0-42cf-8b59-f2f6a92f573f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:18.931363 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8efe2c84-26f0-42cf-8b59-f2f6a92f573f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:18.939625 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8efe2c84-26f0-42cf-8b59-f2f6a92f573f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:18.941106 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8efe2c84-26f0-42cf-8b59-f2f6a92f573f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:18.942890 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-8efe2c84-26f0-42cf-8b59-f2f6a92f573f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.150673 Jul 13 21:09:18.943452 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 339/669] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:18 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:19.001072 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-9de92af0-8d64-4094-a7ef-0378a35f8080 req-2b41dbc3-3254-48e5-a60b-66137ec4d211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e9318b8-72a2-4ff2-bd83-00cffd180921", "name": "network-vif-plugged", "status": "completed", "tag": "3dd595db-0847-4e1d-91fd-0fa7b77936d6"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:09:19.010905 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-9de92af0-8d64-4094-a7ef-0378a35f8080 req-2b41dbc3-3254-48e5-a60b-66137ec4d211 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:19.011394 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-9de92af0-8d64-4094-a7ef-0378a35f8080 req-2b41dbc3-3254-48e5-a60b-66137ec4d211 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:19.022747 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-9de92af0-8d64-4094-a7ef-0378a35f8080 req-2b41dbc3-3254-48e5-a60b-66137ec4d211 service nova] Creating event network-vif-plugged:3dd595db-0847-4e1d-91fd-0fa7b77936d6 for instance 8e9318b8-72a2-4ff2-bd83-00cffd180921 on hv-cinder-79987 Jul 13 21:09:19.027462 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-9de92af0-8d64-4094-a7ef-0378a35f8080 req-2b41dbc3-3254-48e5-a60b-66137ec4d211 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030018 Jul 13 21:09:19.028050 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 331/670] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:09:19.503792 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-81ee08e1-0d35-4736-9eb8-625107528d2a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:19.504420 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-81ee08e1-0d35-4736-9eb8-625107528d2a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: 8e9318b8-72a2-4ff2-bd83-00cffd180921] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:19.506367 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=4 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:09:19.507120 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=16 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:09:19.513559 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-81ee08e1-0d35-4736-9eb8-625107528d2a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:19.514000 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-81ee08e1-0d35-4736-9eb8-625107528d2a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:19.514802 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-81ee08e1-0d35-4736-9eb8-625107528d2a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:19.515268 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-81ee08e1-0d35-4736-9eb8-625107528d2a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:19.590408 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell0:SELECT=4 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:09:19.595725 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-119bab99-c31d-4770-a093-70eda1c411b9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:19.596411 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-119bab99-c31d-4770-a093-70eda1c411b9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:19.603686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-119bab99-c31d-4770-a093-70eda1c411b9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:19.604392 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-119bab99-c31d-4770-a093-70eda1c411b9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:19.605440 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-119bab99-c31d-4770-a093-70eda1c411b9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:19.605882 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-119bab99-c31d-4770-a093-70eda1c411b9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:19.648970 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-81ee08e1-0d35-4736-9eb8-625107528d2a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:19.656419 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-81ee08e1-0d35-4736-9eb8-625107528d2a tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921" status: 200 len: 1317 microversion: 2.1 time: 0.159906 Jul 13 21:09:19.656987 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 340/671] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:19 2022] GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:19.733487 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-119bab99-c31d-4770-a093-70eda1c411b9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:19.740799 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-119bab99-c31d-4770-a093-70eda1c411b9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1372 microversion: 2.1 time: 0.151306 Jul 13 21:09:19.741356 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 332/672] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:19 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:09:19.962024 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-5c5b1577-d39e-425e-8470-3eb67e2c57c6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:19.962636 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-5c5b1577-d39e-425e-8470-3eb67e2c57c6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:19.968476 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5c5b1577-d39e-425e-8470-3eb67e2c57c6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:19.968920 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5c5b1577-d39e-425e-8470-3eb67e2c57c6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:19.969681 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5c5b1577-d39e-425e-8470-3eb67e2c57c6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:19.970111 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5c5b1577-d39e-425e-8470-3eb67e2c57c6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:20.098372 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5c5b1577-d39e-425e-8470-3eb67e2c57c6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:20.108357 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5c5b1577-d39e-425e-8470-3eb67e2c57c6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:20.109913 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5c5b1577-d39e-425e-8470-3eb67e2c57c6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:20.111091 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-5c5b1577-d39e-425e-8470-3eb67e2c57c6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.153684 Jul 13 21:09:20.111650 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 341/673] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:19 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:20.673411 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-e9bda471-5384-48e7-9ac4-a3658d61b841 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:20.674017 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-e9bda471-5384-48e7-9ac4-a3658d61b841 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: 8e9318b8-72a2-4ff2-bd83-00cffd180921] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:20.680956 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e9bda471-5384-48e7-9ac4-a3658d61b841 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:20.681399 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e9bda471-5384-48e7-9ac4-a3658d61b841 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:20.682154 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e9bda471-5384-48e7-9ac4-a3658d61b841 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:20.682590 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e9bda471-5384-48e7-9ac4-a3658d61b841 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:20.757698 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-058bfd36-1372-4463-805a-84215947403c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:20.758397 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-058bfd36-1372-4463-805a-84215947403c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:20.765321 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-058bfd36-1372-4463-805a-84215947403c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:20.765768 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-058bfd36-1372-4463-805a-84215947403c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:20.766532 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-058bfd36-1372-4463-805a-84215947403c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:20.767055 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-058bfd36-1372-4463-805a-84215947403c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:20.830719 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-e9bda471-5384-48e7-9ac4-a3658d61b841 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:20.838306 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-e9bda471-5384-48e7-9ac4-a3658d61b841 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921" status: 200 len: 1317 microversion: 2.1 time: 0.168639 Jul 13 21:09:20.838831 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 333/674] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:20 2022] GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:20.893263 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-058bfd36-1372-4463-805a-84215947403c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:20.900704 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-058bfd36-1372-4463-805a-84215947403c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1372 microversion: 2.1 time: 0.146913 Jul 13 21:09:20.901272 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 342/675] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:20 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:09:21.129059 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-771f0a84-4b35-4716-9e49-81070077a145 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:21.130306 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-771f0a84-4b35-4716-9e49-81070077a145 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:21.136208 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-771f0a84-4b35-4716-9e49-81070077a145 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:21.136650 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-771f0a84-4b35-4716-9e49-81070077a145 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:21.137394 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-771f0a84-4b35-4716-9e49-81070077a145 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:21.137822 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-771f0a84-4b35-4716-9e49-81070077a145 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:21.263562 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-771f0a84-4b35-4716-9e49-81070077a145 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:21.272437 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-771f0a84-4b35-4716-9e49-81070077a145 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:21.273909 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-771f0a84-4b35-4716-9e49-81070077a145 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:21.275067 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-771f0a84-4b35-4716-9e49-81070077a145 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.149856 Jul 13 21:09:21.275625 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 334/676] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:21 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:21.854741 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-3bc18315-ef50-4cb5-b142-c56cfea1eaa5 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:21.855350 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-3bc18315-ef50-4cb5-b142-c56cfea1eaa5 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: 8e9318b8-72a2-4ff2-bd83-00cffd180921] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:21.861778 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3bc18315-ef50-4cb5-b142-c56cfea1eaa5 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:21.862226 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3bc18315-ef50-4cb5-b142-c56cfea1eaa5 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:21.863017 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3bc18315-ef50-4cb5-b142-c56cfea1eaa5 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:21.863455 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3bc18315-ef50-4cb5-b142-c56cfea1eaa5 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:21.917280 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-aad6396d-2192-461b-a66f-ebd00179fe8f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:21.918042 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-aad6396d-2192-461b-a66f-ebd00179fe8f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:21.924679 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-aad6396d-2192-461b-a66f-ebd00179fe8f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:21.925574 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-aad6396d-2192-461b-a66f-ebd00179fe8f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:21.925893 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-aad6396d-2192-461b-a66f-ebd00179fe8f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:21.926849 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-aad6396d-2192-461b-a66f-ebd00179fe8f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:22.011705 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3bc18315-ef50-4cb5-b142-c56cfea1eaa5 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:22.021999 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-3bc18315-ef50-4cb5-b142-c56cfea1eaa5 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921" status: 200 len: 1317 microversion: 2.1 time: 0.171010 Jul 13 21:09:22.023074 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 343/677] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:21 2022] GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:22.159411 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-aad6396d-2192-461b-a66f-ebd00179fe8f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:22.167423 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-aad6396d-2192-461b-a66f-ebd00179fe8f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1372 microversion: 2.1 time: 0.253916 Jul 13 21:09:22.167986 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 335/678] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:21 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1372 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:09:22.293104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-10b4f20e-f55a-424f-9268-3637142e3499 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:22.293697 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-10b4f20e-f55a-424f-9268-3637142e3499 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:22.299724 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-10b4f20e-f55a-424f-9268-3637142e3499 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:22.300165 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-10b4f20e-f55a-424f-9268-3637142e3499 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:22.300909 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-10b4f20e-f55a-424f-9268-3637142e3499 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:22.301340 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-10b4f20e-f55a-424f-9268-3637142e3499 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:22.429081 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-10b4f20e-f55a-424f-9268-3637142e3499 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:22.437313 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-10b4f20e-f55a-424f-9268-3637142e3499 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:22.438814 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-10b4f20e-f55a-424f-9268-3637142e3499 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:22.439951 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-10b4f20e-f55a-424f-9268-3637142e3499 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.150685 Jul 13 21:09:22.440493 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 344/679] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:22 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:23.039280 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-49724c9e-733a-43e2-8e88-e8ebfa0d0303 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:23.039887 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-49724c9e-733a-43e2-8e88-e8ebfa0d0303 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: 8e9318b8-72a2-4ff2-bd83-00cffd180921] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:23.046321 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-49724c9e-733a-43e2-8e88-e8ebfa0d0303 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:23.046824 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-49724c9e-733a-43e2-8e88-e8ebfa0d0303 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:23.047591 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-49724c9e-733a-43e2-8e88-e8ebfa0d0303 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:23.048028 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-49724c9e-733a-43e2-8e88-e8ebfa0d0303 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:23.178724 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-49724c9e-733a-43e2-8e88-e8ebfa0d0303 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:23.184496 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-6040bffb-d8a5-4b35-ac2c-e813c19b3f83 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:23.185097 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-6040bffb-d8a5-4b35-ac2c-e813c19b3f83 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:23.186155 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-49724c9e-733a-43e2-8e88-e8ebfa0d0303 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921" status: 200 len: 1507 microversion: 2.1 time: 0.151242 Jul 13 21:09:23.186804 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 336/680] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:23 2022] GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:23.193280 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6040bffb-d8a5-4b35-ac2c-e813c19b3f83 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:23.193723 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6040bffb-d8a5-4b35-ac2c-e813c19b3f83 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:23.194489 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6040bffb-d8a5-4b35-ac2c-e813c19b3f83 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:23.194963 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6040bffb-d8a5-4b35-ac2c-e813c19b3f83 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:23.202762 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-f54a3bd7-2f6d-4066-a478-69398f13fabb tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6df367ba-f116-4887-bff2-4d7ee5cda426", "device": "/dev/sdb"}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:09:23.203924 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-f54a3bd7-2f6d-4066-a478-69398f13fabb tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: 8e9318b8-72a2-4ff2-bd83-00cffd180921] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:23.210398 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f54a3bd7-2f6d-4066-a478-69398f13fabb tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:23.210891 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f54a3bd7-2f6d-4066-a478-69398f13fabb tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:23.211745 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f54a3bd7-2f6d-4066-a478-69398f13fabb tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:23.212185 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f54a3bd7-2f6d-4066-a478-69398f13fabb tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:23.327500 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-6040bffb-d8a5-4b35-ac2c-e813c19b3f83 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:23.336909 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-6040bffb-d8a5-4b35-ac2c-e813c19b3f83 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1372 microversion: 2.1 time: 0.156323 Jul 13 21:09:23.338574 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 345/681] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:23 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:09:23.460193 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-bbc7a481-b674-46a1-8563-0a904911b986 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:23.460868 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-bbc7a481-b674-46a1-8563-0a904911b986 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:23.470215 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bbc7a481-b674-46a1-8563-0a904911b986 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:23.470682 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bbc7a481-b674-46a1-8563-0a904911b986 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:23.474603 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bbc7a481-b674-46a1-8563-0a904911b986 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:23.475355 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bbc7a481-b674-46a1-8563-0a904911b986 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:23.527942 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-f54a3bd7-2f6d-4066-a478-69398f13fabb tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "POST /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.327554 Jul 13 21:09:23.531562 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 337/682] 10.222.0.39 () {60 vars in 1322 bytes} [Wed Jul 13 21:09:23 2022] POST /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:09:23.668159 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-518d8b28-2edf-45c0-8e79-6bf90e78ceab req-5afc57e4-69a3-438d-be36-9008ccde3b33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e5ee85-86cb-4ee9-9002-22ded6b91cdd", "name": "network-vif-plugged", "status": "completed", "tag": "b2e4f436-9a2c-40fa-b1c8-e749b75a70b9"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:09:23.681083 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-518d8b28-2edf-45c0-8e79-6bf90e78ceab req-5afc57e4-69a3-438d-be36-9008ccde3b33 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:23.681790 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-518d8b28-2edf-45c0-8e79-6bf90e78ceab req-5afc57e4-69a3-438d-be36-9008ccde3b33 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:23.697110 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-518d8b28-2edf-45c0-8e79-6bf90e78ceab req-5afc57e4-69a3-438d-be36-9008ccde3b33 service nova] Creating event network-vif-plugged:b2e4f436-9a2c-40fa-b1c8-e749b75a70b9 for instance 84e5ee85-86cb-4ee9-9002-22ded6b91cdd on hv-cinder-79987 Jul 13 21:09:23.703010 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-518d8b28-2edf-45c0-8e79-6bf90e78ceab req-5afc57e4-69a3-438d-be36-9008ccde3b33 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039303 Jul 13 21:09:23.704183 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 338/683] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:09:23.742588 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-bbc7a481-b674-46a1-8563-0a904911b986 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:23.753911 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-bbc7a481-b674-46a1-8563-0a904911b986 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:23.755597 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-bbc7a481-b674-46a1-8563-0a904911b986 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:23.756906 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-bbc7a481-b674-46a1-8563-0a904911b986 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.301819 Jul 13 21:09:23.758655 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 346/684] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:23 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:24.355984 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-4a1e32df-d07a-4be8-a6e6-d6509286c1e7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:24.356700 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-4a1e32df-d07a-4be8-a6e6-d6509286c1e7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:24.362778 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4a1e32df-d07a-4be8-a6e6-d6509286c1e7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:24.363224 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4a1e32df-d07a-4be8-a6e6-d6509286c1e7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:24.364001 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4a1e32df-d07a-4be8-a6e6-d6509286c1e7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:24.364431 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4a1e32df-d07a-4be8-a6e6-d6509286c1e7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:24.368290 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:09:24.493696 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-4a1e32df-d07a-4be8-a6e6-d6509286c1e7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:24.501016 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-4a1e32df-d07a-4be8-a6e6-d6509286c1e7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1372 microversion: 2.1 time: 0.149632 Jul 13 21:09:24.501578 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 339/685] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:24 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:24.776640 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-b383a48b-ace7-4a78-a210-3f7e9696d483 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:24.777241 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-b383a48b-ace7-4a78-a210-3f7e9696d483 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:24.784103 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b383a48b-ace7-4a78-a210-3f7e9696d483 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:24.784552 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b383a48b-ace7-4a78-a210-3f7e9696d483 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:24.785351 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b383a48b-ace7-4a78-a210-3f7e9696d483 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:24.785767 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b383a48b-ace7-4a78-a210-3f7e9696d483 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:24.916525 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b383a48b-ace7-4a78-a210-3f7e9696d483 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:24.924768 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b383a48b-ace7-4a78-a210-3f7e9696d483 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:24.926762 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b383a48b-ace7-4a78-a210-3f7e9696d483 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:24.927900 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-b383a48b-ace7-4a78-a210-3f7e9696d483 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.155248 Jul 13 21:09:24.928452 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 347/686] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:24 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:25.520294 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-c3026856-8f4c-472b-b9ee-8100813d65f0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:25.521032 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-c3026856-8f4c-472b-b9ee-8100813d65f0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:25.528114 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c3026856-8f4c-472b-b9ee-8100813d65f0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:25.528563 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c3026856-8f4c-472b-b9ee-8100813d65f0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:25.529365 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c3026856-8f4c-472b-b9ee-8100813d65f0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:25.529848 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c3026856-8f4c-472b-b9ee-8100813d65f0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:25.663892 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-c3026856-8f4c-472b-b9ee-8100813d65f0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:25.671726 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-c3026856-8f4c-472b-b9ee-8100813d65f0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1372 microversion: 2.1 time: 0.156724 Jul 13 21:09:25.672304 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 340/687] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:25 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:25.945965 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-30606c67-2061-4f02-85da-4eebb6e056db tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:25.946604 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-30606c67-2061-4f02-85da-4eebb6e056db tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:25.954104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-30606c67-2061-4f02-85da-4eebb6e056db tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:25.954546 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-30606c67-2061-4f02-85da-4eebb6e056db tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:25.955333 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-30606c67-2061-4f02-85da-4eebb6e056db tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:25.955762 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-30606c67-2061-4f02-85da-4eebb6e056db tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:26.126269 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-30606c67-2061-4f02-85da-4eebb6e056db tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:26.135238 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-30606c67-2061-4f02-85da-4eebb6e056db tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:26.136715 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-30606c67-2061-4f02-85da-4eebb6e056db tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:26.137878 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-30606c67-2061-4f02-85da-4eebb6e056db tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.196333 Jul 13 21:09:26.138654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 348/688] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:25 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:26.690252 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-f64f48ca-eb29-4189-b8ca-8d46f0e04699 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:26.692669 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-f64f48ca-eb29-4189-b8ca-8d46f0e04699 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:26.700170 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f64f48ca-eb29-4189-b8ca-8d46f0e04699 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:26.700708 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f64f48ca-eb29-4189-b8ca-8d46f0e04699 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:26.701577 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f64f48ca-eb29-4189-b8ca-8d46f0e04699 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:26.702072 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f64f48ca-eb29-4189-b8ca-8d46f0e04699 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:26.848123 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f64f48ca-eb29-4189-b8ca-8d46f0e04699 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:26.855469 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-f64f48ca-eb29-4189-b8ca-8d46f0e04699 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1372 microversion: 2.1 time: 0.170366 Jul 13 21:09:26.856026 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 341/689] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:26 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:27.156222 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-76a3777a-8529-43e2-8857-b0683bed4e95 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:27.156843 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-76a3777a-8529-43e2-8857-b0683bed4e95 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:27.163879 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-76a3777a-8529-43e2-8857-b0683bed4e95 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:27.164324 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-76a3777a-8529-43e2-8857-b0683bed4e95 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:27.165079 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-76a3777a-8529-43e2-8857-b0683bed4e95 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:27.165508 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-76a3777a-8529-43e2-8857-b0683bed4e95 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:27.294857 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-76a3777a-8529-43e2-8857-b0683bed4e95 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:27.303131 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-76a3777a-8529-43e2-8857-b0683bed4e95 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:27.304619 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-76a3777a-8529-43e2-8857-b0683bed4e95 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:27.305766 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-76a3777a-8529-43e2-8857-b0683bed4e95 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.153388 Jul 13 21:09:27.306308 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 349/690] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:27 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:27.874417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-36ccaaad-24fd-405e-86b9-e6a15b381b6a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:27.876075 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-36ccaaad-24fd-405e-86b9-e6a15b381b6a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:27.884399 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-36ccaaad-24fd-405e-86b9-e6a15b381b6a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:27.884847 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-36ccaaad-24fd-405e-86b9-e6a15b381b6a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:27.885609 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-36ccaaad-24fd-405e-86b9-e6a15b381b6a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:27.886039 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-36ccaaad-24fd-405e-86b9-e6a15b381b6a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:28.018444 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-36ccaaad-24fd-405e-86b9-e6a15b381b6a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:28.026267 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-36ccaaad-24fd-405e-86b9-e6a15b381b6a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1372 microversion: 2.1 time: 0.157446 Jul 13 21:09:28.026861 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 342/691] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:27 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:28.323965 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-8cab5a2f-6278-4054-a7d6-be83bfeaf049 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:28.324560 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8cab5a2f-6278-4054-a7d6-be83bfeaf049 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:28.330917 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8cab5a2f-6278-4054-a7d6-be83bfeaf049 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:28.331367 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8cab5a2f-6278-4054-a7d6-be83bfeaf049 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:28.332179 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8cab5a2f-6278-4054-a7d6-be83bfeaf049 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:28.332614 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8cab5a2f-6278-4054-a7d6-be83bfeaf049 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:28.350809 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=100 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:09:28.464930 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8cab5a2f-6278-4054-a7d6-be83bfeaf049 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:28.475110 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8cab5a2f-6278-4054-a7d6-be83bfeaf049 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:28.476672 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8cab5a2f-6278-4054-a7d6-be83bfeaf049 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:28.477931 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-8cab5a2f-6278-4054-a7d6-be83bfeaf049 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.157817 Jul 13 21:09:28.487588 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 350/692] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:28 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:29.043586 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-782660c0-1957-4590-b3b3-f857348329f9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:29.044551 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-782660c0-1957-4590-b3b3-f857348329f9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:29.046861 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_api:SELECT=98 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:09:29.057120 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-782660c0-1957-4590-b3b3-f857348329f9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:29.058363 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-782660c0-1957-4590-b3b3-f857348329f9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:29.059855 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-782660c0-1957-4590-b3b3-f857348329f9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:29.060789 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-782660c0-1957-4590-b3b3-f857348329f9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:29.203631 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-782660c0-1957-4590-b3b3-f857348329f9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:29.211254 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-782660c0-1957-4590-b3b3-f857348329f9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1372 microversion: 2.1 time: 0.171676 Jul 13 21:09:29.212027 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 343/693] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:29 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:29.498973 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-eef04b65-f922-4719-837f-674fe2a89acb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:29.500652 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-eef04b65-f922-4719-837f-674fe2a89acb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:29.507829 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-eef04b65-f922-4719-837f-674fe2a89acb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:29.508280 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-eef04b65-f922-4719-837f-674fe2a89acb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:29.509264 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-eef04b65-f922-4719-837f-674fe2a89acb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:29.509723 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-eef04b65-f922-4719-837f-674fe2a89acb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:29.659732 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-eef04b65-f922-4719-837f-674fe2a89acb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:29.668414 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-eef04b65-f922-4719-837f-674fe2a89acb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:29.670018 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-eef04b65-f922-4719-837f-674fe2a89acb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:29.671312 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-eef04b65-f922-4719-837f-674fe2a89acb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.177922 Jul 13 21:09:29.671954 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 351/694] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:29 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:30.228354 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-57e90f9d-05ef-4f69-857b-d9dd87da74cd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:30.228942 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-57e90f9d-05ef-4f69-857b-d9dd87da74cd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:30.235545 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-57e90f9d-05ef-4f69-857b-d9dd87da74cd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:30.235994 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-57e90f9d-05ef-4f69-857b-d9dd87da74cd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:30.236758 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-57e90f9d-05ef-4f69-857b-d9dd87da74cd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:30.237196 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-57e90f9d-05ef-4f69-857b-d9dd87da74cd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:30.364890 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-57e90f9d-05ef-4f69-857b-d9dd87da74cd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:30.374067 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-57e90f9d-05ef-4f69-857b-d9dd87da74cd tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1372 microversion: 2.1 time: 0.149437 Jul 13 21:09:30.375008 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 344/695] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:30 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:30.689498 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-738db599-4690-476b-b486-8c0c3b318b1e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:30.690140 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-738db599-4690-476b-b486-8c0c3b318b1e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:30.697063 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-738db599-4690-476b-b486-8c0c3b318b1e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:30.697507 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-738db599-4690-476b-b486-8c0c3b318b1e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:30.698256 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-738db599-4690-476b-b486-8c0c3b318b1e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:30.698750 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-738db599-4690-476b-b486-8c0c3b318b1e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:30.828172 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-738db599-4690-476b-b486-8c0c3b318b1e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:30.837867 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-738db599-4690-476b-b486-8c0c3b318b1e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:30.839467 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-738db599-4690-476b-b486-8c0c3b318b1e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:30.840694 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-738db599-4690-476b-b486-8c0c3b318b1e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.155053 Jul 13 21:09:30.841590 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 352/696] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:30 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:31.391659 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-758671c4-82f6-416f-9bab-38ccd008ba25 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:31.392505 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-758671c4-82f6-416f-9bab-38ccd008ba25 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:31.398935 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-758671c4-82f6-416f-9bab-38ccd008ba25 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:31.399379 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-758671c4-82f6-416f-9bab-38ccd008ba25 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:31.400155 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-758671c4-82f6-416f-9bab-38ccd008ba25 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:31.400588 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-758671c4-82f6-416f-9bab-38ccd008ba25 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:31.529505 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-758671c4-82f6-416f-9bab-38ccd008ba25 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:31.537284 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-758671c4-82f6-416f-9bab-38ccd008ba25 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1372 microversion: 2.1 time: 0.149471 Jul 13 21:09:31.537836 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 345/697] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:31 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:09:31.858925 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-91fe8ecf-0aa4-4af2-865d-aad0aca5391f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:31.859668 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-91fe8ecf-0aa4-4af2-865d-aad0aca5391f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:31.866549 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-91fe8ecf-0aa4-4af2-865d-aad0aca5391f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:31.867040 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-91fe8ecf-0aa4-4af2-865d-aad0aca5391f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:31.867815 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-91fe8ecf-0aa4-4af2-865d-aad0aca5391f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:31.868251 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-91fe8ecf-0aa4-4af2-865d-aad0aca5391f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:32.063427 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-91fe8ecf-0aa4-4af2-865d-aad0aca5391f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:32.072978 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-91fe8ecf-0aa4-4af2-865d-aad0aca5391f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:32.074832 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-91fe8ecf-0aa4-4af2-865d-aad0aca5391f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:32.076181 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-91fe8ecf-0aa4-4af2-865d-aad0aca5391f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.221227 Jul 13 21:09:32.088506 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 353/698] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:31 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:32.553698 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-5345cfea-2c22-4db1-a5b2-4892e7a123c2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:32.554304 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-5345cfea-2c22-4db1-a5b2-4892e7a123c2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:32.560657 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5345cfea-2c22-4db1-a5b2-4892e7a123c2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:32.561101 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5345cfea-2c22-4db1-a5b2-4892e7a123c2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:32.561845 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5345cfea-2c22-4db1-a5b2-4892e7a123c2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:32.562274 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5345cfea-2c22-4db1-a5b2-4892e7a123c2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:32.757697 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-5345cfea-2c22-4db1-a5b2-4892e7a123c2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:32.765008 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-5345cfea-2c22-4db1-a5b2-4892e7a123c2 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1372 microversion: 2.1 time: 0.215563 Jul 13 21:09:32.765567 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 346/699] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:32 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1372 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:33.098406 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-8ee31b6b-40dc-4ebb-b28d-ddb8aefe1bf4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:33.099788 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8ee31b6b-40dc-4ebb-b28d-ddb8aefe1bf4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:33.108123 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8ee31b6b-40dc-4ebb-b28d-ddb8aefe1bf4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:33.108701 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8ee31b6b-40dc-4ebb-b28d-ddb8aefe1bf4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:33.109777 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8ee31b6b-40dc-4ebb-b28d-ddb8aefe1bf4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:33.110278 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8ee31b6b-40dc-4ebb-b28d-ddb8aefe1bf4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:33.245332 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8ee31b6b-40dc-4ebb-b28d-ddb8aefe1bf4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:33.254976 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8ee31b6b-40dc-4ebb-b28d-ddb8aefe1bf4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:33.257358 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8ee31b6b-40dc-4ebb-b28d-ddb8aefe1bf4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:33.258765 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-8ee31b6b-40dc-4ebb-b28d-ddb8aefe1bf4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.166615 Jul 13 21:09:33.259661 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 354/700] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:33 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:33.781194 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-c05cbb8a-3832-4771-9a2e-62a22c40f139 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:33.781803 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-c05cbb8a-3832-4771-9a2e-62a22c40f139 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:33.789179 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c05cbb8a-3832-4771-9a2e-62a22c40f139 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:33.789853 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c05cbb8a-3832-4771-9a2e-62a22c40f139 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:33.803740 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c05cbb8a-3832-4771-9a2e-62a22c40f139 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:33.804201 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c05cbb8a-3832-4771-9a2e-62a22c40f139 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:33.935675 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-c05cbb8a-3832-4771-9a2e-62a22c40f139 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:33.943595 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-c05cbb8a-3832-4771-9a2e-62a22c40f139 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1372 microversion: 2.1 time: 0.166151 Jul 13 21:09:33.944346 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 347/701] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:33 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:34.277679 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-68787099-4f41-46e8-913c-6933d6ba4a2f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:34.278826 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-68787099-4f41-46e8-913c-6933d6ba4a2f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:34.284663 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-68787099-4f41-46e8-913c-6933d6ba4a2f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:34.285099 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-68787099-4f41-46e8-913c-6933d6ba4a2f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:34.285846 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-68787099-4f41-46e8-913c-6933d6ba4a2f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:34.286271 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-68787099-4f41-46e8-913c-6933d6ba4a2f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:34.425626 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-68787099-4f41-46e8-913c-6933d6ba4a2f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:34.434275 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-68787099-4f41-46e8-913c-6933d6ba4a2f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:34.435786 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-68787099-4f41-46e8-913c-6933d6ba4a2f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:34.436946 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-68787099-4f41-46e8-913c-6933d6ba4a2f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.163132 Jul 13 21:09:34.437502 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 355/702] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:34 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:34.960353 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ea3e1164-12a3-4d99-8573-a53427d87dad tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:34.960945 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-ea3e1164-12a3-4d99-8573-a53427d87dad tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:34.967384 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ea3e1164-12a3-4d99-8573-a53427d87dad tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:34.967826 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ea3e1164-12a3-4d99-8573-a53427d87dad tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:34.968571 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ea3e1164-12a3-4d99-8573-a53427d87dad tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:34.969002 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ea3e1164-12a3-4d99-8573-a53427d87dad tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:35.099305 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ea3e1164-12a3-4d99-8573-a53427d87dad tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:35.109160 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ea3e1164-12a3-4d99-8573-a53427d87dad tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1372 microversion: 2.1 time: 0.152393 Jul 13 21:09:35.109768 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 348/703] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:34 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:35.455476 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-da6c4411-625b-41ab-bb7f-de8f5564118e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:35.456078 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-da6c4411-625b-41ab-bb7f-de8f5564118e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:35.463005 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-da6c4411-625b-41ab-bb7f-de8f5564118e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:35.463448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-da6c4411-625b-41ab-bb7f-de8f5564118e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:35.464193 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-da6c4411-625b-41ab-bb7f-de8f5564118e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:35.464619 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-da6c4411-625b-41ab-bb7f-de8f5564118e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:35.603478 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-da6c4411-625b-41ab-bb7f-de8f5564118e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:35.612992 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-da6c4411-625b-41ab-bb7f-de8f5564118e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:35.614488 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-da6c4411-625b-41ab-bb7f-de8f5564118e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:35.615750 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-da6c4411-625b-41ab-bb7f-de8f5564118e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.164072 Jul 13 21:09:35.618380 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 356/704] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:35 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:36.128463 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-05bfdd9b-d268-405b-8739-99088586c6f4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:36.129056 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-05bfdd9b-d268-405b-8739-99088586c6f4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:36.136067 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-05bfdd9b-d268-405b-8739-99088586c6f4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:36.136513 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-05bfdd9b-d268-405b-8739-99088586c6f4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:36.137300 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-05bfdd9b-d268-405b-8739-99088586c6f4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:36.137728 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-05bfdd9b-d268-405b-8739-99088586c6f4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:36.282345 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-05bfdd9b-d268-405b-8739-99088586c6f4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:36.290026 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-05bfdd9b-d268-405b-8739-99088586c6f4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1372 microversion: 2.1 time: 0.165332 Jul 13 21:09:36.290699 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 349/705] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:36 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:36.633810 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ddfca379-24e9-4cfa-8b95-9d609b26e92e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:36.634406 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ddfca379-24e9-4cfa-8b95-9d609b26e92e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:36.641010 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ddfca379-24e9-4cfa-8b95-9d609b26e92e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:36.641449 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ddfca379-24e9-4cfa-8b95-9d609b26e92e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:36.642495 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ddfca379-24e9-4cfa-8b95-9d609b26e92e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:36.642951 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ddfca379-24e9-4cfa-8b95-9d609b26e92e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:36.782078 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ddfca379-24e9-4cfa-8b95-9d609b26e92e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:36.790898 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ddfca379-24e9-4cfa-8b95-9d609b26e92e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:36.792370 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ddfca379-24e9-4cfa-8b95-9d609b26e92e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:36.793507 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ddfca379-24e9-4cfa-8b95-9d609b26e92e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.163587 Jul 13 21:09:36.794069 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 357/706] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:36 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:37.305846 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-035dd4f5-7cb7-4a99-a2f5-5504ccbe1c56 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:37.306451 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-035dd4f5-7cb7-4a99-a2f5-5504ccbe1c56 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:37.312955 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-035dd4f5-7cb7-4a99-a2f5-5504ccbe1c56 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:37.313296 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-035dd4f5-7cb7-4a99-a2f5-5504ccbe1c56 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:37.314057 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-035dd4f5-7cb7-4a99-a2f5-5504ccbe1c56 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:37.314496 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-035dd4f5-7cb7-4a99-a2f5-5504ccbe1c56 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:37.445939 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-035dd4f5-7cb7-4a99-a2f5-5504ccbe1c56 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:37.454316 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-035dd4f5-7cb7-4a99-a2f5-5504ccbe1c56 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1372 microversion: 2.1 time: 0.152031 Jul 13 21:09:37.455234 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 350/707] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:37 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:37.811476 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-57e29451-4a42-4ff1-8840-0f8373118269 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:37.812077 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-57e29451-4a42-4ff1-8840-0f8373118269 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:37.819166 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-57e29451-4a42-4ff1-8840-0f8373118269 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:37.819615 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-57e29451-4a42-4ff1-8840-0f8373118269 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:37.820371 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-57e29451-4a42-4ff1-8840-0f8373118269 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:37.820806 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-57e29451-4a42-4ff1-8840-0f8373118269 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:37.953289 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-57e29451-4a42-4ff1-8840-0f8373118269 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:37.961633 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-57e29451-4a42-4ff1-8840-0f8373118269 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:37.963168 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-57e29451-4a42-4ff1-8840-0f8373118269 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:37.964313 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-57e29451-4a42-4ff1-8840-0f8373118269 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.156734 Jul 13 21:09:37.964873 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 358/708] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:37 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:38.471963 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-688fd2b9-12fc-49c1-94cd-f49e75b5fdc3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:38.472564 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-688fd2b9-12fc-49c1-94cd-f49e75b5fdc3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:38.479523 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-688fd2b9-12fc-49c1-94cd-f49e75b5fdc3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:38.479972 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-688fd2b9-12fc-49c1-94cd-f49e75b5fdc3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:38.480724 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-688fd2b9-12fc-49c1-94cd-f49e75b5fdc3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:38.481159 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-688fd2b9-12fc-49c1-94cd-f49e75b5fdc3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:38.606017 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-688fd2b9-12fc-49c1-94cd-f49e75b5fdc3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:38.613388 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-688fd2b9-12fc-49c1-94cd-f49e75b5fdc3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1372 microversion: 2.1 time: 0.145260 Jul 13 21:09:38.613943 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 351/709] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:38 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1372 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:38.982088 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-8022ecf4-6fb2-4a07-ba49-c6e8e81ce87d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:38.982709 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8022ecf4-6fb2-4a07-ba49-c6e8e81ce87d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:38.989118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8022ecf4-6fb2-4a07-ba49-c6e8e81ce87d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:38.989555 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8022ecf4-6fb2-4a07-ba49-c6e8e81ce87d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:38.990303 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8022ecf4-6fb2-4a07-ba49-c6e8e81ce87d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:38.990762 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8022ecf4-6fb2-4a07-ba49-c6e8e81ce87d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:39.121303 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8022ecf4-6fb2-4a07-ba49-c6e8e81ce87d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:39.129540 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8022ecf4-6fb2-4a07-ba49-c6e8e81ce87d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:39.131679 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8022ecf4-6fb2-4a07-ba49-c6e8e81ce87d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:39.132811 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-8022ecf4-6fb2-4a07-ba49-c6e8e81ce87d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.154540 Jul 13 21:09:39.133361 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 359/710] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:38 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:39.629939 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-eab4330f-201d-4f2f-940f-0059375fdc83 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:39.630536 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-eab4330f-201d-4f2f-940f-0059375fdc83 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:39.637002 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eab4330f-201d-4f2f-940f-0059375fdc83 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:39.637442 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eab4330f-201d-4f2f-940f-0059375fdc83 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:39.638187 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eab4330f-201d-4f2f-940f-0059375fdc83 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:39.638634 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eab4330f-201d-4f2f-940f-0059375fdc83 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:39.770810 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-eab4330f-201d-4f2f-940f-0059375fdc83 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:39.778534 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-eab4330f-201d-4f2f-940f-0059375fdc83 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1372 microversion: 2.1 time: 0.152424 Jul 13 21:09:39.779125 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 352/711] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:39 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:40.151450 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-463ff6a3-8dc5-4b7e-b6b9-cda20137d67c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:40.152047 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-463ff6a3-8dc5-4b7e-b6b9-cda20137d67c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:40.158522 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-463ff6a3-8dc5-4b7e-b6b9-cda20137d67c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:40.158990 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-463ff6a3-8dc5-4b7e-b6b9-cda20137d67c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:40.159738 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-463ff6a3-8dc5-4b7e-b6b9-cda20137d67c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:40.160162 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-463ff6a3-8dc5-4b7e-b6b9-cda20137d67c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:40.287978 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-463ff6a3-8dc5-4b7e-b6b9-cda20137d67c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:40.296387 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-463ff6a3-8dc5-4b7e-b6b9-cda20137d67c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:40.297876 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-463ff6a3-8dc5-4b7e-b6b9-cda20137d67c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:40.299055 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-463ff6a3-8dc5-4b7e-b6b9-cda20137d67c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.151422 Jul 13 21:09:40.299609 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 360/712] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:40 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:40.795390 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-971b200c-f3b9-4c16-8bae-80d5972194be tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:40.795988 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-971b200c-f3b9-4c16-8bae-80d5972194be tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:40.803019 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-971b200c-f3b9-4c16-8bae-80d5972194be tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:40.803463 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-971b200c-f3b9-4c16-8bae-80d5972194be tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:40.804210 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-971b200c-f3b9-4c16-8bae-80d5972194be tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:40.804641 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-971b200c-f3b9-4c16-8bae-80d5972194be tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:40.929622 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-971b200c-f3b9-4c16-8bae-80d5972194be tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:40.937075 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-971b200c-f3b9-4c16-8bae-80d5972194be tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1372 microversion: 2.1 time: 0.145412 Jul 13 21:09:40.937580 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 353/713] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:40 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1372 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:41.316533 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-4db3ac6a-a059-4446-aa3e-8cbc402360a2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:41.317079 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-4db3ac6a-a059-4446-aa3e-8cbc402360a2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:41.323840 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4db3ac6a-a059-4446-aa3e-8cbc402360a2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:41.324289 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4db3ac6a-a059-4446-aa3e-8cbc402360a2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:41.325051 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4db3ac6a-a059-4446-aa3e-8cbc402360a2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:41.325487 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4db3ac6a-a059-4446-aa3e-8cbc402360a2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:41.449515 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-4db3ac6a-a059-4446-aa3e-8cbc402360a2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:41.457760 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-4db3ac6a-a059-4446-aa3e-8cbc402360a2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:41.460205 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-4db3ac6a-a059-4446-aa3e-8cbc402360a2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:41.461391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-4db3ac6a-a059-4446-aa3e-8cbc402360a2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.148812 Jul 13 21:09:41.461947 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 361/714] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:41 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:41.953353 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-31de498f-45d2-4399-b05c-25a6fd05f3e3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:41.954010 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-31de498f-45d2-4399-b05c-25a6fd05f3e3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:41.961141 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-31de498f-45d2-4399-b05c-25a6fd05f3e3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:41.961588 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-31de498f-45d2-4399-b05c-25a6fd05f3e3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:41.962347 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-31de498f-45d2-4399-b05c-25a6fd05f3e3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:41.962818 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-31de498f-45d2-4399-b05c-25a6fd05f3e3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:42.088585 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-31de498f-45d2-4399-b05c-25a6fd05f3e3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:42.095925 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-31de498f-45d2-4399-b05c-25a6fd05f3e3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1372 microversion: 2.1 time: 0.146523 Jul 13 21:09:42.096495 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 354/715] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:41 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:42.479811 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-e759bdd7-362d-4d65-9341-e7e37cbee3e7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:42.480434 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-e759bdd7-362d-4d65-9341-e7e37cbee3e7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:42.487145 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e759bdd7-362d-4d65-9341-e7e37cbee3e7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:42.487584 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e759bdd7-362d-4d65-9341-e7e37cbee3e7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:42.488331 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e759bdd7-362d-4d65-9341-e7e37cbee3e7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:42.488756 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e759bdd7-362d-4d65-9341-e7e37cbee3e7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:42.615801 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-e759bdd7-362d-4d65-9341-e7e37cbee3e7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:42.624224 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-e759bdd7-362d-4d65-9341-e7e37cbee3e7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:42.625699 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-e759bdd7-362d-4d65-9341-e7e37cbee3e7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:42.626871 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-e759bdd7-362d-4d65-9341-e7e37cbee3e7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.150860 Jul 13 21:09:42.627429 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 362/716] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:42 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:43.112962 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-efbb456a-046f-4a08-a8a9-c758f2ff7ca1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:43.113689 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-efbb456a-046f-4a08-a8a9-c758f2ff7ca1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:43.120247 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-efbb456a-046f-4a08-a8a9-c758f2ff7ca1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:43.120703 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-efbb456a-046f-4a08-a8a9-c758f2ff7ca1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:43.121472 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-efbb456a-046f-4a08-a8a9-c758f2ff7ca1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:43.121914 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-efbb456a-046f-4a08-a8a9-c758f2ff7ca1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:43.249318 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-efbb456a-046f-4a08-a8a9-c758f2ff7ca1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:43.252790 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=100 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:09:43.258005 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-efbb456a-046f-4a08-a8a9-c758f2ff7ca1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1372 microversion: 2.1 time: 0.148935 Jul 13 21:09:43.258568 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 355/717] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:43 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:43.645312 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-44de7dea-3817-4a7e-aa4d-67c1784123a7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:43.645910 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-44de7dea-3817-4a7e-aa4d-67c1784123a7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:43.652958 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-44de7dea-3817-4a7e-aa4d-67c1784123a7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:43.653412 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-44de7dea-3817-4a7e-aa4d-67c1784123a7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:43.654173 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-44de7dea-3817-4a7e-aa4d-67c1784123a7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:43.654607 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-44de7dea-3817-4a7e-aa4d-67c1784123a7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:43.790630 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-44de7dea-3817-4a7e-aa4d-67c1784123a7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:43.801222 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-44de7dea-3817-4a7e-aa4d-67c1784123a7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:43.803388 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-44de7dea-3817-4a7e-aa4d-67c1784123a7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:43.804593 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-44de7dea-3817-4a7e-aa4d-67c1784123a7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.163371 Jul 13 21:09:43.805151 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 363/718] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:43 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:44.275579 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-e77476e1-3d15-446c-8b65-f3709d9c3bd0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:44.276191 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-e77476e1-3d15-446c-8b65-f3709d9c3bd0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:44.282887 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e77476e1-3d15-446c-8b65-f3709d9c3bd0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:44.283337 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e77476e1-3d15-446c-8b65-f3709d9c3bd0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:44.284092 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e77476e1-3d15-446c-8b65-f3709d9c3bd0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:44.284529 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e77476e1-3d15-446c-8b65-f3709d9c3bd0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:44.411892 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-e77476e1-3d15-446c-8b65-f3709d9c3bd0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:44.419815 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-e77476e1-3d15-446c-8b65-f3709d9c3bd0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1372 microversion: 2.1 time: 0.148456 Jul 13 21:09:44.420383 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 356/719] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:44 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:44.823302 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-0e4d6954-3fd6-4552-a50c-62e34901b634 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:44.823895 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-0e4d6954-3fd6-4552-a50c-62e34901b634 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:44.830269 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0e4d6954-3fd6-4552-a50c-62e34901b634 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:44.830766 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0e4d6954-3fd6-4552-a50c-62e34901b634 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:44.831522 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0e4d6954-3fd6-4552-a50c-62e34901b634 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:44.831950 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0e4d6954-3fd6-4552-a50c-62e34901b634 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:44.956222 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-0e4d6954-3fd6-4552-a50c-62e34901b634 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:44.964968 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-0e4d6954-3fd6-4552-a50c-62e34901b634 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:44.966453 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-0e4d6954-3fd6-4552-a50c-62e34901b634 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:44.967632 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-0e4d6954-3fd6-4552-a50c-62e34901b634 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.148247 Jul 13 21:09:44.968184 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 364/720] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:44 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:45.436743 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-fd0753d5-a469-4ca5-b7c7-27b29ba523ec tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:45.437415 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-fd0753d5-a469-4ca5-b7c7-27b29ba523ec tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:45.444149 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fd0753d5-a469-4ca5-b7c7-27b29ba523ec tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:45.444604 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fd0753d5-a469-4ca5-b7c7-27b29ba523ec tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:45.445383 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fd0753d5-a469-4ca5-b7c7-27b29ba523ec tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:45.445826 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fd0753d5-a469-4ca5-b7c7-27b29ba523ec tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:45.680808 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-fd0753d5-a469-4ca5-b7c7-27b29ba523ec tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:45.689791 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-fd0753d5-a469-4ca5-b7c7-27b29ba523ec tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1372 microversion: 2.1 time: 0.256805 Jul 13 21:09:45.690869 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 357/721] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:45 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1372 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:45.985210 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-96a70796-dfd1-47ea-80fd-e7418328b7f8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:45.985849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-96a70796-dfd1-47ea-80fd-e7418328b7f8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:45.988083 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_api:SELECT=62 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:09:45.993400 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-96a70796-dfd1-47ea-80fd-e7418328b7f8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:45.993837 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-96a70796-dfd1-47ea-80fd-e7418328b7f8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:45.994584 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-96a70796-dfd1-47ea-80fd-e7418328b7f8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:45.995034 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-96a70796-dfd1-47ea-80fd-e7418328b7f8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:46.123374 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-96a70796-dfd1-47ea-80fd-e7418328b7f8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:46.132116 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-96a70796-dfd1-47ea-80fd-e7418328b7f8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:46.133594 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-96a70796-dfd1-47ea-80fd-e7418328b7f8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:46.134770 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-96a70796-dfd1-47ea-80fd-e7418328b7f8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.153431 Jul 13 21:09:46.135321 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 365/722] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:45 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:46.707004 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b233835d-701a-4d20-aa01-55ba005bd087 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:46.707606 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b233835d-701a-4d20-aa01-55ba005bd087 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:46.714008 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b233835d-701a-4d20-aa01-55ba005bd087 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:46.714460 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b233835d-701a-4d20-aa01-55ba005bd087 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:46.715261 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b233835d-701a-4d20-aa01-55ba005bd087 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:46.715698 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b233835d-701a-4d20-aa01-55ba005bd087 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:46.850571 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b233835d-701a-4d20-aa01-55ba005bd087 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:46.857970 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b233835d-701a-4d20-aa01-55ba005bd087 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1567 microversion: 2.1 time: 0.154840 Jul 13 21:09:46.858526 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 358/723] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:09:46 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:09:46.874491 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-f0493a39-998a-4d3a-890b-c05633319a7d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:46.875003 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-f0493a39-998a-4d3a-890b-c05633319a7d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:46.881481 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f0493a39-998a-4d3a-890b-c05633319a7d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:46.881923 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f0493a39-998a-4d3a-890b-c05633319a7d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:46.882693 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f0493a39-998a-4d3a-890b-c05633319a7d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:46.883119 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f0493a39-998a-4d3a-890b-c05633319a7d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:46.958805 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-f0493a39-998a-4d3a-890b-c05633319a7d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087931 Jul 13 21:09:46.959376 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 366/724] 10.222.0.39 () {58 vars in 1274 bytes} [Wed Jul 13 21:09:46 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:09:47.153117 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ba998ba1-c67f-485f-a91d-71498b2ab9ae tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:47.153758 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-ba998ba1-c67f-485f-a91d-71498b2ab9ae tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:47.159887 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ba998ba1-c67f-485f-a91d-71498b2ab9ae tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:47.160337 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ba998ba1-c67f-485f-a91d-71498b2ab9ae tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:47.161108 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ba998ba1-c67f-485f-a91d-71498b2ab9ae tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:47.161544 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ba998ba1-c67f-485f-a91d-71498b2ab9ae tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:47.295355 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ba998ba1-c67f-485f-a91d-71498b2ab9ae tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:47.303799 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ba998ba1-c67f-485f-a91d-71498b2ab9ae tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:47.305281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ba998ba1-c67f-485f-a91d-71498b2ab9ae tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:47.306431 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ba998ba1-c67f-485f-a91d-71498b2ab9ae tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.157209 Jul 13 21:09:47.307023 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 359/725] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:47 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:48.059971 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-f0be9683-d737-425a-bb58-b0c5c8d18bb7 req-4aece7f9-9ffe-4bfc-b3d0-8359254e0607 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84e5ee85-86cb-4ee9-9002-22ded6b91cdd", "tag": "b2e4f436-9a2c-40fa-b1c8-e749b75a70b9"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:09:48.067985 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-f0be9683-d737-425a-bb58-b0c5c8d18bb7 req-4aece7f9-9ffe-4bfc-b3d0-8359254e0607 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:48.069098 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-f0be9683-d737-425a-bb58-b0c5c8d18bb7 req-4aece7f9-9ffe-4bfc-b3d0-8359254e0607 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:48.079767 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-f0be9683-d737-425a-bb58-b0c5c8d18bb7 req-4aece7f9-9ffe-4bfc-b3d0-8359254e0607 service nova] Creating event network-changed:b2e4f436-9a2c-40fa-b1c8-e749b75a70b9 for instance 84e5ee85-86cb-4ee9-9002-22ded6b91cdd on hv-cinder-79987 Jul 13 21:09:48.085082 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-f0be9683-d737-425a-bb58-b0c5c8d18bb7 req-4aece7f9-9ffe-4bfc-b3d0-8359254e0607 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029236 Jul 13 21:09:48.085652 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 367/726] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:09:48.325386 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-c8f3ff1d-890d-439f-8336-e7b576c8e24d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:48.325909 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-c8f3ff1d-890d-439f-8336-e7b576c8e24d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:48.332363 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c8f3ff1d-890d-439f-8336-e7b576c8e24d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:48.332814 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c8f3ff1d-890d-439f-8336-e7b576c8e24d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:48.333578 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c8f3ff1d-890d-439f-8336-e7b576c8e24d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:48.334010 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c8f3ff1d-890d-439f-8336-e7b576c8e24d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:48.466943 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-c8f3ff1d-890d-439f-8336-e7b576c8e24d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:48.475904 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-c8f3ff1d-890d-439f-8336-e7b576c8e24d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:48.477443 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-c8f3ff1d-890d-439f-8336-e7b576c8e24d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:48.478787 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-c8f3ff1d-890d-439f-8336-e7b576c8e24d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.157228 Jul 13 21:09:48.479440 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 360/727] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:48 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:49.170334 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 13 21:09:49.170580 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Wed Jul 13 21:09:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 13 21:09:49.597755 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-a847b679-ac97-406e-b125-beca28933cbc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:49.598439 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-a847b679-ac97-406e-b125-beca28933cbc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:49.604557 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a847b679-ac97-406e-b125-beca28933cbc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:49.605053 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a847b679-ac97-406e-b125-beca28933cbc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:49.605803 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a847b679-ac97-406e-b125-beca28933cbc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:49.606229 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a847b679-ac97-406e-b125-beca28933cbc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:49.610113 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=100 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:09:49.731982 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-a847b679-ac97-406e-b125-beca28933cbc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:49.740636 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-a847b679-ac97-406e-b125-beca28933cbc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:49.742117 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-a847b679-ac97-406e-b125-beca28933cbc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:49.743288 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-a847b679-ac97-406e-b125-beca28933cbc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.250100 Jul 13 21:09:49.743840 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 368/728] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:49 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:50.762317 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-fbc433ad-795a-49ef-9c8f-913f561bdc10 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:50.762973 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-fbc433ad-795a-49ef-9c8f-913f561bdc10 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:50.769653 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fbc433ad-795a-49ef-9c8f-913f561bdc10 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:50.770098 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fbc433ad-795a-49ef-9c8f-913f561bdc10 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:50.770882 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fbc433ad-795a-49ef-9c8f-913f561bdc10 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:50.771934 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fbc433ad-795a-49ef-9c8f-913f561bdc10 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:50.898202 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-fbc433ad-795a-49ef-9c8f-913f561bdc10 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:50.906692 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-fbc433ad-795a-49ef-9c8f-913f561bdc10 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:50.908187 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-fbc433ad-795a-49ef-9c8f-913f561bdc10 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:50.909338 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-fbc433ad-795a-49ef-9c8f-913f561bdc10 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.150985 Jul 13 21:09:50.909892 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 361/729] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:50 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:51.927814 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-2b7498c2-1780-4086-b783-60c52b92b659 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:51.928414 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-2b7498c2-1780-4086-b783-60c52b92b659 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:51.934936 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2b7498c2-1780-4086-b783-60c52b92b659 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:51.935382 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2b7498c2-1780-4086-b783-60c52b92b659 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:51.936172 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2b7498c2-1780-4086-b783-60c52b92b659 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:51.936587 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2b7498c2-1780-4086-b783-60c52b92b659 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:52.095419 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-2b7498c2-1780-4086-b783-60c52b92b659 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:52.104498 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-2b7498c2-1780-4086-b783-60c52b92b659 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:52.106007 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-2b7498c2-1780-4086-b783-60c52b92b659 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:52.107310 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-2b7498c2-1780-4086-b783-60c52b92b659 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.183769 Jul 13 21:09:52.118121 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 369/730] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:51 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:53.125593 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-f29514e4-fb90-4007-956b-1a22087c655f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:53.126593 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-f29514e4-fb90-4007-956b-1a22087c655f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:53.133687 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f29514e4-fb90-4007-956b-1a22087c655f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:53.134143 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f29514e4-fb90-4007-956b-1a22087c655f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:53.134933 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f29514e4-fb90-4007-956b-1a22087c655f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:53.135367 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f29514e4-fb90-4007-956b-1a22087c655f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:53.290234 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f29514e4-fb90-4007-956b-1a22087c655f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:53.298572 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f29514e4-fb90-4007-956b-1a22087c655f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:53.300066 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f29514e4-fb90-4007-956b-1a22087c655f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:53.301195 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-f29514e4-fb90-4007-956b-1a22087c655f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.179625 Jul 13 21:09:53.301732 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 362/731] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:53 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:54.059167 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-89992065-f22f-4e99-9a41-2a42ad2b5128 req-138cf6b8-38e6-4a19-96af-091f53258157 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12316d28-2975-4c1e-b05b-82a3253bb35f", "name": "network-vif-plugged", "status": "completed", "tag": "8d927002-4a46-4df8-b48a-c6cb84decd8d"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:09:54.068637 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-89992065-f22f-4e99-9a41-2a42ad2b5128 req-138cf6b8-38e6-4a19-96af-091f53258157 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:54.069066 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-89992065-f22f-4e99-9a41-2a42ad2b5128 req-138cf6b8-38e6-4a19-96af-091f53258157 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:54.082365 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-89992065-f22f-4e99-9a41-2a42ad2b5128 req-138cf6b8-38e6-4a19-96af-091f53258157 service nova] Creating event network-vif-plugged:8d927002-4a46-4df8-b48a-c6cb84decd8d for instance 12316d28-2975-4c1e-b05b-82a3253bb35f on hv-cinder-79987 Jul 13 21:09:54.087323 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-89992065-f22f-4e99-9a41-2a42ad2b5128 req-138cf6b8-38e6-4a19-96af-091f53258157 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031783 Jul 13 21:09:54.087919 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 370/732] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:09:54.319884 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-361f0f6f-ed08-4765-809d-13d4c43003b4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:54.320476 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-361f0f6f-ed08-4765-809d-13d4c43003b4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:54.326930 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-361f0f6f-ed08-4765-809d-13d4c43003b4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:54.327381 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-361f0f6f-ed08-4765-809d-13d4c43003b4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:54.328160 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-361f0f6f-ed08-4765-809d-13d4c43003b4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:54.328625 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-361f0f6f-ed08-4765-809d-13d4c43003b4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:54.454286 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-361f0f6f-ed08-4765-809d-13d4c43003b4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:54.462552 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-361f0f6f-ed08-4765-809d-13d4c43003b4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:54.464514 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-361f0f6f-ed08-4765-809d-13d4c43003b4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:54.465694 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-361f0f6f-ed08-4765-809d-13d4c43003b4 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.150194 Jul 13 21:09:54.466242 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 363/733] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:54 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:55.485420 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-a1e7ef8c-1344-481f-a7be-25088041c7eb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:55.486112 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-a1e7ef8c-1344-481f-a7be-25088041c7eb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:55.492279 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a1e7ef8c-1344-481f-a7be-25088041c7eb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:55.492734 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a1e7ef8c-1344-481f-a7be-25088041c7eb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:55.493490 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a1e7ef8c-1344-481f-a7be-25088041c7eb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:55.493927 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a1e7ef8c-1344-481f-a7be-25088041c7eb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:55.618161 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-a1e7ef8c-1344-481f-a7be-25088041c7eb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:55.626458 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-a1e7ef8c-1344-481f-a7be-25088041c7eb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:55.627991 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-a1e7ef8c-1344-481f-a7be-25088041c7eb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:55.629143 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-a1e7ef8c-1344-481f-a7be-25088041c7eb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.148435 Jul 13 21:09:55.629696 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 371/734] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:55 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:56.648281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-bc27bc53-62ba-423c-8107-d1f997974a82 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:56.648884 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-bc27bc53-62ba-423c-8107-d1f997974a82 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:56.655367 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bc27bc53-62ba-423c-8107-d1f997974a82 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:56.655800 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bc27bc53-62ba-423c-8107-d1f997974a82 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:56.656557 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bc27bc53-62ba-423c-8107-d1f997974a82 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:56.656995 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bc27bc53-62ba-423c-8107-d1f997974a82 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:56.804161 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-bc27bc53-62ba-423c-8107-d1f997974a82 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:56.820404 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-bc27bc53-62ba-423c-8107-d1f997974a82 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:56.822026 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-bc27bc53-62ba-423c-8107-d1f997974a82 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:56.823282 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-bc27bc53-62ba-423c-8107-d1f997974a82 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.179424 Jul 13 21:09:56.823844 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 364/735] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:56 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:57.842943 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-1af37e1f-526d-4844-bae1-8e6440e36aee tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:57.843540 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-1af37e1f-526d-4844-bae1-8e6440e36aee tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:57.850814 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1af37e1f-526d-4844-bae1-8e6440e36aee tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:57.851258 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1af37e1f-526d-4844-bae1-8e6440e36aee tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:57.852014 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1af37e1f-526d-4844-bae1-8e6440e36aee tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:57.852444 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1af37e1f-526d-4844-bae1-8e6440e36aee tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:57.976572 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-1af37e1f-526d-4844-bae1-8e6440e36aee tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:57.984828 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-1af37e1f-526d-4844-bae1-8e6440e36aee tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:57.986314 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-1af37e1f-526d-4844-bae1-8e6440e36aee tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:57.987508 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-1af37e1f-526d-4844-bae1-8e6440e36aee tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.148611 Jul 13 21:09:57.988055 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 372/736] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:57 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:09:59.005176 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ed4716ea-9609-4be1-bd98-f670cb27b6a8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:09:59.005773 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-ed4716ea-9609-4be1-bd98-f670cb27b6a8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:09:59.012175 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ed4716ea-9609-4be1-bd98-f670cb27b6a8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:59.012618 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ed4716ea-9609-4be1-bd98-f670cb27b6a8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:59.013540 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ed4716ea-9609-4be1-bd98-f670cb27b6a8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:09:59.013975 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ed4716ea-9609-4be1-bd98-f670cb27b6a8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:09:59.148196 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ed4716ea-9609-4be1-bd98-f670cb27b6a8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:59.156473 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ed4716ea-9609-4be1-bd98-f670cb27b6a8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:59.157946 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ed4716ea-9609-4be1-bd98-f670cb27b6a8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:09:59.159108 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ed4716ea-9609-4be1-bd98-f670cb27b6a8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.157766 Jul 13 21:09:59.159657 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 365/737] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:09:59 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:10:00.177663 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-7e7c2344-9d8d-4bf7-bf5b-24684dd6d393 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:00.178319 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-7e7c2344-9d8d-4bf7-bf5b-24684dd6d393 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:00.184805 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7e7c2344-9d8d-4bf7-bf5b-24684dd6d393 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:00.185249 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7e7c2344-9d8d-4bf7-bf5b-24684dd6d393 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:00.186006 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7e7c2344-9d8d-4bf7-bf5b-24684dd6d393 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:00.186435 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7e7c2344-9d8d-4bf7-bf5b-24684dd6d393 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:00.316421 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-7e7c2344-9d8d-4bf7-bf5b-24684dd6d393 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:00.325323 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-7e7c2344-9d8d-4bf7-bf5b-24684dd6d393 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:00.326902 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-7e7c2344-9d8d-4bf7-bf5b-24684dd6d393 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:00.328034 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-7e7c2344-9d8d-4bf7-bf5b-24684dd6d393 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.154732 Jul 13 21:10:00.328585 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 373/738] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:10:00 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:10:01.345174 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-142c12fe-7559-40d0-8329-6d8b0305183f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:01.345958 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-142c12fe-7559-40d0-8329-6d8b0305183f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:01.348406 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_api:SELECT=46 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:10:01.354564 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-142c12fe-7559-40d0-8329-6d8b0305183f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:01.355122 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-142c12fe-7559-40d0-8329-6d8b0305183f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:01.355916 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-142c12fe-7559-40d0-8329-6d8b0305183f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:01.356345 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-142c12fe-7559-40d0-8329-6d8b0305183f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:01.492919 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-142c12fe-7559-40d0-8329-6d8b0305183f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:01.501182 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-142c12fe-7559-40d0-8329-6d8b0305183f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:01.502699 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-142c12fe-7559-40d0-8329-6d8b0305183f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:01.503843 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-142c12fe-7559-40d0-8329-6d8b0305183f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.162513 Jul 13 21:10:01.504390 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 366/739] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:10:01 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:10:02.523067 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ee7dcdf4-6933-4a09-8039-d864cb196d32 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:02.523663 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ee7dcdf4-6933-4a09-8039-d864cb196d32 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:02.530214 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ee7dcdf4-6933-4a09-8039-d864cb196d32 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:02.530593 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ee7dcdf4-6933-4a09-8039-d864cb196d32 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:02.531369 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ee7dcdf4-6933-4a09-8039-d864cb196d32 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:02.531796 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ee7dcdf4-6933-4a09-8039-d864cb196d32 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:02.657124 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ee7dcdf4-6933-4a09-8039-d864cb196d32 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:02.665515 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ee7dcdf4-6933-4a09-8039-d864cb196d32 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:02.667042 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ee7dcdf4-6933-4a09-8039-d864cb196d32 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:02.668194 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ee7dcdf4-6933-4a09-8039-d864cb196d32 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.149486 Jul 13 21:10:02.668757 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 374/740] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:10:02 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:10:03.686033 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-9a00e739-45a0-4987-b438-01ff4c98f877 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:03.686644 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-9a00e739-45a0-4987-b438-01ff4c98f877 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:03.693144 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9a00e739-45a0-4987-b438-01ff4c98f877 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:03.693595 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9a00e739-45a0-4987-b438-01ff4c98f877 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:03.694351 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9a00e739-45a0-4987-b438-01ff4c98f877 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:03.694821 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9a00e739-45a0-4987-b438-01ff4c98f877 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:03.820620 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-9a00e739-45a0-4987-b438-01ff4c98f877 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:03.828848 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-9a00e739-45a0-4987-b438-01ff4c98f877 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:03.830329 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-9a00e739-45a0-4987-b438-01ff4c98f877 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:03.831509 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-9a00e739-45a0-4987-b438-01ff4c98f877 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.149330 Jul 13 21:10:03.832064 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 367/741] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:10:03 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:10:04.849971 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-3ed2b427-58d4-4fdb-91e3-e5b1e3a90676 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:04.850563 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-3ed2b427-58d4-4fdb-91e3-e5b1e3a90676 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:04.857117 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3ed2b427-58d4-4fdb-91e3-e5b1e3a90676 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:04.857551 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3ed2b427-58d4-4fdb-91e3-e5b1e3a90676 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:04.858293 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3ed2b427-58d4-4fdb-91e3-e5b1e3a90676 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:04.858757 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3ed2b427-58d4-4fdb-91e3-e5b1e3a90676 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:04.986078 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3ed2b427-58d4-4fdb-91e3-e5b1e3a90676 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:04.994898 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3ed2b427-58d4-4fdb-91e3-e5b1e3a90676 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:04.996375 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3ed2b427-58d4-4fdb-91e3-e5b1e3a90676 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:04.997507 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-3ed2b427-58d4-4fdb-91e3-e5b1e3a90676 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.151378 Jul 13 21:10:04.998057 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 375/742] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:10:04 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:10:06.015626 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-1ab6b1e9-5461-438f-912a-d9c5159f7de6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:06.016417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-1ab6b1e9-5461-438f-912a-d9c5159f7de6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:06.023478 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1ab6b1e9-5461-438f-912a-d9c5159f7de6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:06.023929 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1ab6b1e9-5461-438f-912a-d9c5159f7de6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:06.024677 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1ab6b1e9-5461-438f-912a-d9c5159f7de6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:06.025107 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1ab6b1e9-5461-438f-912a-d9c5159f7de6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:06.158102 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-1ab6b1e9-5461-438f-912a-d9c5159f7de6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:06.166763 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-1ab6b1e9-5461-438f-912a-d9c5159f7de6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:06.168268 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-1ab6b1e9-5461-438f-912a-d9c5159f7de6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:06.169408 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-1ab6b1e9-5461-438f-912a-d9c5159f7de6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.157805 Jul 13 21:10:06.169958 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 368/743] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:10:06 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:10:07.187836 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-de6147d7-5c26-4cff-925f-193925694185 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:07.188546 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-de6147d7-5c26-4cff-925f-193925694185 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:07.195590 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-de6147d7-5c26-4cff-925f-193925694185 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:07.196024 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-de6147d7-5c26-4cff-925f-193925694185 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:07.196777 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-de6147d7-5c26-4cff-925f-193925694185 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:07.197201 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-de6147d7-5c26-4cff-925f-193925694185 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:07.328403 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-de6147d7-5c26-4cff-925f-193925694185 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:07.337515 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-de6147d7-5c26-4cff-925f-193925694185 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:07.339033 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-de6147d7-5c26-4cff-925f-193925694185 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:07.340186 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-de6147d7-5c26-4cff-925f-193925694185 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1808 microversion: 2.20 time: 0.156193 Jul 13 21:10:07.340737 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 376/744] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:10:07 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:10:08.358663 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-6f7fcd6c-1bdd-4786-ba34-dfc034e03ec3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:08.359261 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-6f7fcd6c-1bdd-4786-ba34-dfc034e03ec3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:08.365861 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6f7fcd6c-1bdd-4786-ba34-dfc034e03ec3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:08.366316 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6f7fcd6c-1bdd-4786-ba34-dfc034e03ec3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:08.367109 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6f7fcd6c-1bdd-4786-ba34-dfc034e03ec3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:08.367577 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6f7fcd6c-1bdd-4786-ba34-dfc034e03ec3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:08.493466 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-6f7fcd6c-1bdd-4786-ba34-dfc034e03ec3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:08.501723 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-6f7fcd6c-1bdd-4786-ba34-dfc034e03ec3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:08.503246 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-6f7fcd6c-1bdd-4786-ba34-dfc034e03ec3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:08.504403 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-6f7fcd6c-1bdd-4786-ba34-dfc034e03ec3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1795 microversion: 2.20 time: 0.149562 Jul 13 21:10:08.504942 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 369/745] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:10:08 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1795 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:10:09.083501 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ba34f098-a663-4ab6-a70d-b9266b663519 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:09.083984 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ba34f098-a663-4ab6-a70d-b9266b663519 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: 8e9318b8-72a2-4ff2-bd83-00cffd180921] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:09.090522 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ba34f098-a663-4ab6-a70d-b9266b663519 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:09.090994 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ba34f098-a663-4ab6-a70d-b9266b663519 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:09.091774 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ba34f098-a663-4ab6-a70d-b9266b663519 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:09.092205 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ba34f098-a663-4ab6-a70d-b9266b663519 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:09.213059 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.objects.instance [None req-ba34f098-a663-4ab6-a70d-b9266b663519 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lazy-loading 'services' on Instance uuid 8e9318b8-72a2-4ff2-bd83-00cffd180921 {{(pid=118445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:10:09.322144 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ba34f098-a663-4ab6-a70d-b9266b663519 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921/os-volume_attachments/6df367ba-f116-4887-bff2-4d7ee5cda426" status: 202 len: 0 microversion: 2.1 time: 0.242247 Jul 13 21:10:09.322686 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 377/746] 10.222.0.39 () {58 vars in 1415 bytes} [Wed Jul 13 21:10:09 2022] DELETE /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921/os-volume_attachments/6df367ba-f116-4887-bff2-4d7ee5cda426 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 21:10:11.488750 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0edd7899-dc89-4720-b7b6-77c65120d39f tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:11.489281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-0edd7899-dc89-4720-b7b6-77c65120d39f tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: 8e9318b8-72a2-4ff2-bd83-00cffd180921] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:11.495718 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0edd7899-dc89-4720-b7b6-77c65120d39f tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:11.496162 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0edd7899-dc89-4720-b7b6-77c65120d39f tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:11.496905 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0edd7899-dc89-4720-b7b6-77c65120d39f tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:11.497333 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0edd7899-dc89-4720-b7b6-77c65120d39f tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:11.521701 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-0edd7899-dc89-4720-b7b6-77c65120d39f tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: 8e9318b8-72a2-4ff2-bd83-00cffd180921] Going to try to terminate instance {{(pid=118444) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 21:10:11.568051 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:10:11.595950 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-0edd7899-dc89-4720-b7b6-77c65120d39f tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921" status: 204 len: 0 microversion: 2.1 time: 0.110410 Jul 13 21:10:11.597023 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 370/747] 10.222.0.39 () {58 vars in 1238 bytes} [Wed Jul 13 21:10:11 2022] DELETE /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 21:10:11.606862 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-624ff8b9-eb40-463f-96be-a55783bd1fc7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:11.607561 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-624ff8b9-eb40-463f-96be-a55783bd1fc7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: 8e9318b8-72a2-4ff2-bd83-00cffd180921] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:11.614918 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-624ff8b9-eb40-463f-96be-a55783bd1fc7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:11.615363 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-624ff8b9-eb40-463f-96be-a55783bd1fc7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:11.616120 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-624ff8b9-eb40-463f-96be-a55783bd1fc7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:11.616550 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-624ff8b9-eb40-463f-96be-a55783bd1fc7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:11.745819 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-624ff8b9-eb40-463f-96be-a55783bd1fc7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:11.753156 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-624ff8b9-eb40-463f-96be-a55783bd1fc7 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921" status: 200 len: 1513 microversion: 2.1 time: 0.150563 Jul 13 21:10:11.753720 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 378/748] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:10:11 2022] GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:10:12.771857 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-48c00b5a-8784-4198-b9f9-21ff481eacdb tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:12.772548 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-48c00b5a-8784-4198-b9f9-21ff481eacdb tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: 8e9318b8-72a2-4ff2-bd83-00cffd180921] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:12.778924 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-48c00b5a-8784-4198-b9f9-21ff481eacdb tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:12.779369 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-48c00b5a-8784-4198-b9f9-21ff481eacdb tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:12.780111 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-48c00b5a-8784-4198-b9f9-21ff481eacdb tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:12.780538 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-48c00b5a-8784-4198-b9f9-21ff481eacdb tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:12.906687 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-48c00b5a-8784-4198-b9f9-21ff481eacdb tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:12.913935 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-48c00b5a-8784-4198-b9f9-21ff481eacdb tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921" status: 200 len: 1513 microversion: 2.1 time: 0.146861 Jul 13 21:10:12.914495 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 371/749] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:10:12 2022] GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921 => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:10:13.930416 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-af18e0ae-72d9-4ef8-b304-e246b5b33441 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:13.931042 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-af18e0ae-72d9-4ef8-b304-e246b5b33441 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: 8e9318b8-72a2-4ff2-bd83-00cffd180921] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:13.937571 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-af18e0ae-72d9-4ef8-b304-e246b5b33441 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:13.938018 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-af18e0ae-72d9-4ef8-b304-e246b5b33441 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:13.938804 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-af18e0ae-72d9-4ef8-b304-e246b5b33441 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:13.939234 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-af18e0ae-72d9-4ef8-b304-e246b5b33441 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:14.065540 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-af18e0ae-72d9-4ef8-b304-e246b5b33441 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9074c8e166b4cd2a3cff41f0ccca273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332a661874a4a2faebb32a154be663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:14.073559 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-af18e0ae-72d9-4ef8-b304-e246b5b33441 tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921" status: 200 len: 1513 microversion: 2.1 time: 0.146949 Jul 13 21:10:14.074139 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 379/750] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:10:13 2022] GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921 => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:10:14.497309 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-3f00b9df-5008-46e7-91b4-703ea054d87c req-9d0f5a9f-0dab-4793-b9b8-6a2d21412a3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e9318b8-72a2-4ff2-bd83-00cffd180921", "name": "network-vif-deleted", "tag": "3dd595db-0847-4e1d-91fd-0fa7b77936d6"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:10:14.506916 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-3f00b9df-5008-46e7-91b4-703ea054d87c req-9d0f5a9f-0dab-4793-b9b8-6a2d21412a3d service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:14.507295 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-3f00b9df-5008-46e7-91b4-703ea054d87c req-9d0f5a9f-0dab-4793-b9b8-6a2d21412a3d service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:14.520790 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-3f00b9df-5008-46e7-91b4-703ea054d87c req-9d0f5a9f-0dab-4793-b9b8-6a2d21412a3d service nova] Creating event network-vif-deleted:3dd595db-0847-4e1d-91fd-0fa7b77936d6 for instance 8e9318b8-72a2-4ff2-bd83-00cffd180921 on hv-cinder-79987 Jul 13 21:10:14.526091 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-3f00b9df-5008-46e7-91b4-703ea054d87c req-9d0f5a9f-0dab-4793-b9b8-6a2d21412a3d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032511 Jul 13 21:10:14.527219 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 372/751] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:10:15.090527 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-08c21a74-e788-4bbf-9a48-62108d01629c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:15.091424 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-08c21a74-e788-4bbf-9a48-62108d01629c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] [instance: 8e9318b8-72a2-4ff2-bd83-00cffd180921] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:15.098870 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-08c21a74-e788-4bbf-9a48-62108d01629c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:15.099956 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-08c21a74-e788-4bbf-9a48-62108d01629c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:15.100717 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-08c21a74-e788-4bbf-9a48-62108d01629c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:15.101143 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-08c21a74-e788-4bbf-9a48-62108d01629c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:15.118480 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.wsgi [None req-08c21a74-e788-4bbf-9a48-62108d01629c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] HTTP exception thrown: Instance 8e9318b8-72a2-4ff2-bd83-00cffd180921 could not be found. Jul 13 21:10:15.120133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-08c21a74-e788-4bbf-9a48-62108d01629c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Request method failure captured: Jul 13 21:10:15.120133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: request: GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921 HTTP/1.1 Jul 13 21:10:15.120133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept: application/json Jul 13 21:10:15.120133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept-Encoding: identity Jul 13 21:10:15.120133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Connection: close Jul 13 21:10:15.120133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Length: 0 Jul 13 21:10:15.120133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Type: application/json Jul 13 21:10:15.120133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Host: 10.222.0.39 Jul 13 21:10:15.120133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Openstack-System-Scope: None Jul 13 21:10:15.120133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: User-Agent: python-urllib3/1.26.9 Jul 13 21:10:15.120133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Auth-Token: gAAAAABizzP35idd4F4638Gwp2bitPASGdNQfRyp7UPMJyMQwSxVCn3ajkGdV-UPLCH0k0Top6sNHlWXZxWInENwdwVUMuDP2UVov4IZTkvA9OKeXpbSpv-LL1KltoIzqYS8rApU8GhTryLzXAVeeK-QKCcJ0qyS84rqUH3m4MuCww7dPd8Q1H4 Jul 13 21:10:15.120133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Id: None Jul 13 21:10:15.120133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Name: None Jul 13 21:10:15.120133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Identity-Status: Confirmed Jul 13 21:10:15.120133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Is-Admin-Project: True Jul 13 21:10:15.120133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Id: default Jul 13 21:10:15.120133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Name: Default Jul 13 21:10:15.120133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Id: 2332a661874a4a2faebb32a154be663c Jul 13 21:10:15.120133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Name: tempest-VolumesSnapshotTestJSON-863081210 Jul 13 21:10:15.120133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Role: member,reader Jul 13 21:10:15.120133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Roles: member,reader Jul 13 21:10:15.121490 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2332a661874a4a2faebb32a154be663c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2332a661874a4a2faebb32a154be663c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2332a661874a4a2faebb32a154be663c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2332a661874a4a2faebb32a154be663c"}]}] Jul 13 21:10:15.121490 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant: tempest-VolumesSnapshotTestJSON-863081210 Jul 13 21:10:15.121490 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Id: 2332a661874a4a2faebb32a154be663c Jul 13 21:10:15.121490 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-863081210 Jul 13 21:10:15.121490 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User: tempest-VolumesSnapshotTestJSON-863081210-project Jul 13 21:10:15.121490 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Id: default Jul 13 21:10:15.121490 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Name: Default Jul 13 21:10:15.121490 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Id: c9074c8e166b4cd2a3cff41f0ccca273 Jul 13 21:10:15.121490 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Name: tempest-VolumesSnapshotTestJSON-863081210-project Jul 13 21:10:15.121490 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: method: > Jul 13 21:10:15.121490 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: exception: Instance 8e9318b8-72a2-4ff2-bd83-00cffd180921 could not be found. Jul 13 21:10:15.121490 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: action_args: {'id': '8e9318b8-72a2-4ff2-bd83-00cffd180921'} Jul 13 21:10:15.122238 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:10:15.122238 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:10:15.122238 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:10:15.122238 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:10:15.122238 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:10:15.122238 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:10:15.122238 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:10:15.122238 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:10:15.122238 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:10:15.122238 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:10:15.122238 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e9318b8-72a2-4ff2-bd83-00cffd180921 could not be found. Jul 13 21:10:15.122238 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:10:15.122238 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:10:15.122238 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:10:15.122238 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:10:15.122238 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:10:15.122238 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:10:15.122238 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:10:15.122238 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:10:15.122238 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:10:15.123889 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:10:15.123889 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 21:10:15.123889 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 21:10:15.123889 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:10:15.123889 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:10:15.123889 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:10:15.123889 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:10:15.123889 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e9318b8-72a2-4ff2-bd83-00cffd180921 could not be found. Jul 13 21:10:15.123889 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:10:15.123889 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:10:15.123889 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:10:15.123889 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:10:15.123889 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:10:15.123889 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:10:15.123889 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:10:15.123889 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:10:15.123889 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e9318b8-72a2-4ff2-bd83-00cffd180921 could not be found. Jul 13 21:10:15.123889 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:10:15.126328 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-08c21a74-e788-4bbf-9a48-62108d01629c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] Returning 404 to user: Instance 8e9318b8-72a2-4ff2-bd83-00cffd180921 could not be found. {{(pid=118445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:10:15.126328 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-08c21a74-e788-4bbf-9a48-62108d01629c tempest-VolumesSnapshotTestJSON-863081210 tempest-VolumesSnapshotTestJSON-863081210-project] 10.222.0.39 "GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921" status: 404 len: 111 microversion: 2.1 time: 0.034999 Jul 13 21:10:15.126328 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 380/752] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:10:15 2022] GET /compute/v2.1/servers/8e9318b8-72a2-4ff2-bd83-00cffd180921 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 13 21:10:23.920668 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-09e17117-0e8b-4e6a-b4c6-7f2d8657999b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:10:23.921638 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-09e17117-0e8b-4e6a-b4c6-7f2d8657999b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:23.928341 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-09e17117-0e8b-4e6a-b4c6-7f2d8657999b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:23.928780 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-09e17117-0e8b-4e6a-b4c6-7f2d8657999b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:23.929525 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-09e17117-0e8b-4e6a-b4c6-7f2d8657999b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:23.929954 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-09e17117-0e8b-4e6a-b4c6-7f2d8657999b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:23.997962 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-09e17117-0e8b-4e6a-b4c6-7f2d8657999b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "POST /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786/action" status: 202 len: 0 microversion: 2.1 time: 0.082261 Jul 13 21:10:23.998769 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 373/753] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Jul 13 21:10:23 2022] POST /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 21:10:24.006509 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c50a3cc9-c79e-4f5c-b997-1bb0532552ec tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:24.007228 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-c50a3cc9-c79e-4f5c-b997-1bb0532552ec tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:24.009949 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_api:SELECT=32 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:10:24.015959 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c50a3cc9-c79e-4f5c-b997-1bb0532552ec tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:24.016384 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c50a3cc9-c79e-4f5c-b997-1bb0532552ec tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:24.017171 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c50a3cc9-c79e-4f5c-b997-1bb0532552ec tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:24.017608 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c50a3cc9-c79e-4f5c-b997-1bb0532552ec tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:24.022185 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=1 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:10:24.318487 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c50a3cc9-c79e-4f5c-b997-1bb0532552ec tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:24.326532 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-c50a3cc9-c79e-4f5c-b997-1bb0532552ec tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1752 microversion: 2.1 time: 0.323834 Jul 13 21:10:24.327311 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 381/754] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:10:24 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1752 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:10:25.345413 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-71d3ce43-7ec6-4f1d-ba06-a917b00f7e71 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:25.346107 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-71d3ce43-7ec6-4f1d-ba06-a917b00f7e71 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:25.352817 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-71d3ce43-7ec6-4f1d-ba06-a917b00f7e71 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:25.353266 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-71d3ce43-7ec6-4f1d-ba06-a917b00f7e71 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:25.354016 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-71d3ce43-7ec6-4f1d-ba06-a917b00f7e71 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:25.354452 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-71d3ce43-7ec6-4f1d-ba06-a917b00f7e71 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:25.491168 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-71d3ce43-7ec6-4f1d-ba06-a917b00f7e71 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:25.498999 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-71d3ce43-7ec6-4f1d-ba06-a917b00f7e71 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1757 microversion: 2.1 time: 0.158348 Jul 13 21:10:25.499563 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 374/755] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:10:25 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:10:26.515796 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-9ab07353-38cc-4c6e-98a4-52f875fb51db tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:26.516399 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-9ab07353-38cc-4c6e-98a4-52f875fb51db tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:26.523053 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9ab07353-38cc-4c6e-98a4-52f875fb51db tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:26.523507 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9ab07353-38cc-4c6e-98a4-52f875fb51db tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:26.524274 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9ab07353-38cc-4c6e-98a4-52f875fb51db tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:26.524710 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9ab07353-38cc-4c6e-98a4-52f875fb51db tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:26.664921 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-9ab07353-38cc-4c6e-98a4-52f875fb51db tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:26.672752 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-9ab07353-38cc-4c6e-98a4-52f875fb51db tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1757 microversion: 2.1 time: 0.161018 Jul 13 21:10:26.673303 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 382/756] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:10:26 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:10:27.690068 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-edfb6609-0c64-458c-8f4c-7dd04168acf8 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:27.690728 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-edfb6609-0c64-458c-8f4c-7dd04168acf8 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:27.697720 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-edfb6609-0c64-458c-8f4c-7dd04168acf8 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:27.698173 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-edfb6609-0c64-458c-8f4c-7dd04168acf8 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:27.698968 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-edfb6609-0c64-458c-8f4c-7dd04168acf8 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:27.699406 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-edfb6609-0c64-458c-8f4c-7dd04168acf8 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:27.841014 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-edfb6609-0c64-458c-8f4c-7dd04168acf8 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:27.848897 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-edfb6609-0c64-458c-8f4c-7dd04168acf8 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1757 microversion: 2.1 time: 0.162710 Jul 13 21:10:27.849465 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 375/757] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:10:27 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:10:28.868148 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-90319d8b-94fb-45fc-ae90-7de7052bb93e tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:28.868771 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-90319d8b-94fb-45fc-ae90-7de7052bb93e tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:28.874826 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-90319d8b-94fb-45fc-ae90-7de7052bb93e tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:28.875260 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-90319d8b-94fb-45fc-ae90-7de7052bb93e tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:28.876006 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-90319d8b-94fb-45fc-ae90-7de7052bb93e tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:28.876432 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-90319d8b-94fb-45fc-ae90-7de7052bb93e tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:29.019091 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-90319d8b-94fb-45fc-ae90-7de7052bb93e tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:29.027544 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-90319d8b-94fb-45fc-ae90-7de7052bb93e tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1757 microversion: 2.1 time: 0.163187 Jul 13 21:10:29.028093 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 383/758] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:10:28 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:10:30.043896 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-26eaab68-28db-4a59-9b87-5741da173176 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:30.044495 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-26eaab68-28db-4a59-9b87-5741da173176 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:30.051000 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-26eaab68-28db-4a59-9b87-5741da173176 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:30.051445 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-26eaab68-28db-4a59-9b87-5741da173176 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:30.052221 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-26eaab68-28db-4a59-9b87-5741da173176 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:30.052650 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-26eaab68-28db-4a59-9b87-5741da173176 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:30.190113 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-26eaab68-28db-4a59-9b87-5741da173176 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:30.198116 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-26eaab68-28db-4a59-9b87-5741da173176 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1757 microversion: 2.1 time: 0.158069 Jul 13 21:10:30.198687 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 376/759] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:10:30 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1757 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:10:31.215034 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-882adad4-81a4-4870-a56f-5009dc8f278b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:31.215628 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-882adad4-81a4-4870-a56f-5009dc8f278b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:31.222121 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-882adad4-81a4-4870-a56f-5009dc8f278b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:31.222560 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-882adad4-81a4-4870-a56f-5009dc8f278b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:31.223334 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-882adad4-81a4-4870-a56f-5009dc8f278b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:31.223761 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-882adad4-81a4-4870-a56f-5009dc8f278b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:31.365256 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-882adad4-81a4-4870-a56f-5009dc8f278b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:31.373736 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-882adad4-81a4-4870-a56f-5009dc8f278b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1757 microversion: 2.1 time: 0.162551 Jul 13 21:10:31.374294 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 384/760] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:10:31 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:10:32.390780 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-2da5f9a5-122a-47b6-bc64-8fe9a709ce86 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:32.391316 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-2da5f9a5-122a-47b6-bc64-8fe9a709ce86 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:32.393666 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:10:32.398880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2da5f9a5-122a-47b6-bc64-8fe9a709ce86 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:32.399325 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2da5f9a5-122a-47b6-bc64-8fe9a709ce86 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:32.400073 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2da5f9a5-122a-47b6-bc64-8fe9a709ce86 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:32.400500 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2da5f9a5-122a-47b6-bc64-8fe9a709ce86 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:32.540051 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-2da5f9a5-122a-47b6-bc64-8fe9a709ce86 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:32.547823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-2da5f9a5-122a-47b6-bc64-8fe9a709ce86 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1757 microversion: 2.1 time: 0.161254 Jul 13 21:10:32.548384 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 377/761] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:10:32 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:10:33.564538 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-b932a69e-21fb-4e83-9e8a-b63e69fe1c1b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:33.565099 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-b932a69e-21fb-4e83-9e8a-b63e69fe1c1b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:33.572009 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b932a69e-21fb-4e83-9e8a-b63e69fe1c1b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:33.572449 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b932a69e-21fb-4e83-9e8a-b63e69fe1c1b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:33.573192 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b932a69e-21fb-4e83-9e8a-b63e69fe1c1b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:33.573618 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b932a69e-21fb-4e83-9e8a-b63e69fe1c1b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:33.715191 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b932a69e-21fb-4e83-9e8a-b63e69fe1c1b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:33.723130 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-b932a69e-21fb-4e83-9e8a-b63e69fe1c1b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1757 microversion: 2.1 time: 0.162475 Jul 13 21:10:33.723683 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 385/762] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:10:33 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:10:34.741096 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-f074530a-b1ef-437e-b400-9a2f7b0dc1f0 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:34.741953 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-f074530a-b1ef-437e-b400-9a2f7b0dc1f0 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:34.749020 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f074530a-b1ef-437e-b400-9a2f7b0dc1f0 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:34.749466 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f074530a-b1ef-437e-b400-9a2f7b0dc1f0 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:34.750222 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f074530a-b1ef-437e-b400-9a2f7b0dc1f0 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:34.750685 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f074530a-b1ef-437e-b400-9a2f7b0dc1f0 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:34.890268 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f074530a-b1ef-437e-b400-9a2f7b0dc1f0 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:34.898794 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-f074530a-b1ef-437e-b400-9a2f7b0dc1f0 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1757 microversion: 2.1 time: 0.162618 Jul 13 21:10:34.899351 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 378/763] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:10:34 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:10:35.916128 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-9d3a5b4d-3415-4e78-9d43-e9bbf2c914f2 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:35.916734 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-9d3a5b4d-3415-4e78-9d43-e9bbf2c914f2 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:35.923293 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9d3a5b4d-3415-4e78-9d43-e9bbf2c914f2 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:35.923802 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9d3a5b4d-3415-4e78-9d43-e9bbf2c914f2 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:35.924495 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9d3a5b4d-3415-4e78-9d43-e9bbf2c914f2 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:35.924931 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9d3a5b4d-3415-4e78-9d43-e9bbf2c914f2 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:36.063561 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-9d3a5b4d-3415-4e78-9d43-e9bbf2c914f2 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:36.071454 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-9d3a5b4d-3415-4e78-9d43-e9bbf2c914f2 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1757 microversion: 2.1 time: 0.159699 Jul 13 21:10:36.072011 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 386/764] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:10:35 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:10:37.089116 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-502ed194-90c7-4f11-9878-a395d83b4702 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:37.089675 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-502ed194-90c7-4f11-9878-a395d83b4702 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:37.096017 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-502ed194-90c7-4f11-9878-a395d83b4702 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:37.096462 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-502ed194-90c7-4f11-9878-a395d83b4702 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:37.097207 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-502ed194-90c7-4f11-9878-a395d83b4702 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:37.097638 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-502ed194-90c7-4f11-9878-a395d83b4702 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:37.237138 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-502ed194-90c7-4f11-9878-a395d83b4702 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:37.244954 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-502ed194-90c7-4f11-9878-a395d83b4702 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1757 microversion: 2.1 time: 0.160366 Jul 13 21:10:37.245501 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 379/765] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:10:37 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:10:38.261216 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ce159961-bd4a-4f79-ba04-92c233847f1d tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:38.261822 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ce159961-bd4a-4f79-ba04-92c233847f1d tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:38.268772 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ce159961-bd4a-4f79-ba04-92c233847f1d tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:38.269441 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ce159961-bd4a-4f79-ba04-92c233847f1d tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:38.270306 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ce159961-bd4a-4f79-ba04-92c233847f1d tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:38.270793 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ce159961-bd4a-4f79-ba04-92c233847f1d tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:38.414729 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ce159961-bd4a-4f79-ba04-92c233847f1d tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:38.422562 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ce159961-bd4a-4f79-ba04-92c233847f1d tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1757 microversion: 2.1 time: 0.165200 Jul 13 21:10:38.423153 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 387/766] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:10:38 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:10:39.438924 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-66f0d726-3ad6-48ff-b302-37220d70a43b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:39.439522 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-66f0d726-3ad6-48ff-b302-37220d70a43b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:39.445937 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-66f0d726-3ad6-48ff-b302-37220d70a43b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:39.446381 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-66f0d726-3ad6-48ff-b302-37220d70a43b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:39.447261 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-66f0d726-3ad6-48ff-b302-37220d70a43b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:39.447752 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-66f0d726-3ad6-48ff-b302-37220d70a43b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:39.586604 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-66f0d726-3ad6-48ff-b302-37220d70a43b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:39.594369 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-66f0d726-3ad6-48ff-b302-37220d70a43b tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1757 microversion: 2.1 time: 0.159331 Jul 13 21:10:39.594959 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 380/767] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:10:39 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:10:40.611194 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-42db826b-ff39-4dfa-bd9d-706ac6d874b3 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:40.611803 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-42db826b-ff39-4dfa-bd9d-706ac6d874b3 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:40.618750 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-42db826b-ff39-4dfa-bd9d-706ac6d874b3 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:40.619202 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-42db826b-ff39-4dfa-bd9d-706ac6d874b3 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:40.619964 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-42db826b-ff39-4dfa-bd9d-706ac6d874b3 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:40.620404 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-42db826b-ff39-4dfa-bd9d-706ac6d874b3 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:40.758462 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-42db826b-ff39-4dfa-bd9d-706ac6d874b3 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:40.766906 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-42db826b-ff39-4dfa-bd9d-706ac6d874b3 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1757 microversion: 2.1 time: 0.159616 Jul 13 21:10:40.767469 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 388/768] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:10:40 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:10:41.785518 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-9f68f0de-a2b1-40f7-9d03-c739d77d442a tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:41.786319 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-9f68f0de-a2b1-40f7-9d03-c739d77d442a tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:41.797263 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9f68f0de-a2b1-40f7-9d03-c739d77d442a tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:41.797833 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9f68f0de-a2b1-40f7-9d03-c739d77d442a tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:41.798750 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9f68f0de-a2b1-40f7-9d03-c739d77d442a tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:41.799300 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9f68f0de-a2b1-40f7-9d03-c739d77d442a tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:41.803566 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:10:42.005769 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-9f68f0de-a2b1-40f7-9d03-c739d77d442a tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:42.015103 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-9f68f0de-a2b1-40f7-9d03-c739d77d442a tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1760 microversion: 2.1 time: 0.233517 Jul 13 21:10:42.026111 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 381/769] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:10:41 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1760 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:10:55.399580 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_api:SELECT=15 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:10:55.400304 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=47 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:10:55.610816 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-2fbe084c-9040-450a-9ac6-035cca04057c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:55.611351 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-2fbe084c-9040-450a-9ac6-035cca04057c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:55.617258 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2fbe084c-9040-450a-9ac6-035cca04057c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:55.617686 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2fbe084c-9040-450a-9ac6-035cca04057c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:55.618434 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2fbe084c-9040-450a-9ac6-035cca04057c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:55.618884 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2fbe084c-9040-450a-9ac6-035cca04057c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:55.695659 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.objects.instance [None req-2fbe084c-9040-450a-9ac6-035cca04057c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lazy-loading 'services' on Instance uuid bcbf4753-6006-45d1-af09-33b6f6047153 {{(pid=118445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:10:55.765092 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-2fbe084c-9040-450a-9ac6-035cca04057c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "DELETE /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153/os-volume_attachments/d57d16ce-9432-4c0e-a787-907b1510e67a" status: 202 len: 0 microversion: 2.1 time: 0.370359 Jul 13 21:10:55.765657 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 389/770] 10.222.0.39 () {58 vars in 1415 bytes} [Wed Jul 13 21:10:55 2022] DELETE /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153/os-volume_attachments/d57d16ce-9432-4c0e-a787-907b1510e67a => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 21:10:57.926831 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-66c8b17e-9d9d-49dc-9da0-565ca4f44c44 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:10:57.928882 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_api:SELECT=9 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:10:57.929517 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=5 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:10:57.935959 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-66c8b17e-9d9d-49dc-9da0-565ca4f44c44 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:57.936413 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-66c8b17e-9d9d-49dc-9da0-565ca4f44c44 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:57.957701 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-66c8b17e-9d9d-49dc-9da0-565ca4f44c44 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Going to try to stop instance {{(pid=118444) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 13 21:10:57.998761 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-66c8b17e-9d9d-49dc-9da0-565ca4f44c44 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "POST /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153/action" status: 202 len: 0 microversion: 2.1 time: 0.075834 Jul 13 21:10:57.999394 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 382/771] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Jul 13 21:10:57 2022] POST /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 21:10:58.008794 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-3eaa3c3f-548f-4b4f-a4f7-9f376a569515 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:58.009428 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-3eaa3c3f-548f-4b4f-a4f7-9f376a569515 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:58.015983 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3eaa3c3f-548f-4b4f-a4f7-9f376a569515 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:58.016424 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3eaa3c3f-548f-4b4f-a4f7-9f376a569515 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:58.017190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3eaa3c3f-548f-4b4f-a4f7-9f376a569515 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:58.017612 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3eaa3c3f-548f-4b4f-a4f7-9f376a569515 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:58.147676 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3eaa3c3f-548f-4b4f-a4f7-9f376a569515 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:58.155683 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-3eaa3c3f-548f-4b4f-a4f7-9f376a569515 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1677 microversion: 2.1 time: 0.151644 Jul 13 21:10:58.156377 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 390/772] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:10:58 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:10:59.174224 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-4db59d77-fb95-4d3d-8792-ce573a297f0f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:59.174962 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-4db59d77-fb95-4d3d-8792-ce573a297f0f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:59.181774 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4db59d77-fb95-4d3d-8792-ce573a297f0f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:59.182226 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4db59d77-fb95-4d3d-8792-ce573a297f0f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:59.183024 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4db59d77-fb95-4d3d-8792-ce573a297f0f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:59.183464 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4db59d77-fb95-4d3d-8792-ce573a297f0f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:59.313635 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-4db59d77-fb95-4d3d-8792-ce573a297f0f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:59.321105 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-4db59d77-fb95-4d3d-8792-ce573a297f0f tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1677 microversion: 2.1 time: 0.151562 Jul 13 21:10:59.322212 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 383/773] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:10:59 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:10:59.586076 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-4c13da1f-a7af-45f9-95af-88f05c947e4c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:59.586561 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-4c13da1f-a7af-45f9-95af-88f05c947e4c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:59.592421 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4c13da1f-a7af-45f9-95af-88f05c947e4c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:59.592856 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4c13da1f-a7af-45f9-95af-88f05c947e4c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:59.593604 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4c13da1f-a7af-45f9-95af-88f05c947e4c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:59.594029 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4c13da1f-a7af-45f9-95af-88f05c947e4c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:59.615768 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-4c13da1f-a7af-45f9-95af-88f05c947e4c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f/ips" status: 200 len: 150 microversion: 2.1 time: 0.133323 Jul 13 21:10:59.616324 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 391/774] 10.222.0.39 () {58 vars in 1247 bytes} [Wed Jul 13 21:10:59 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f/ips => generated 150 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:10:59.626542 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-c39f0c78-d51a-4e1a-923a-c7e1754e79cd tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83d3f6e3-7c40-4e17-ab1d-b04484673266"}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:10:59.627670 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-c39f0c78-d51a-4e1a-923a-c7e1754e79cd tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:59.634203 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c39f0c78-d51a-4e1a-923a-c7e1754e79cd tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:59.634664 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c39f0c78-d51a-4e1a-923a-c7e1754e79cd tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:59.635423 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c39f0c78-d51a-4e1a-923a-c7e1754e79cd tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:59.635857 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c39f0c78-d51a-4e1a-923a-c7e1754e79cd tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:59.712881 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.wsgi [None req-c39f0c78-d51a-4e1a-923a-c7e1754e79cd tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] HTTP exception thrown: Invalid volume: volume 83d3f6e3-7c40-4e17-ab1d-b04484673266 is already attached to instances: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f Jul 13 21:10:59.714573 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-c39f0c78-d51a-4e1a-923a-c7e1754e79cd tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Request method failure captured: Jul 13 21:10:59.714573 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: request: POST /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f/os-volume_attachments HTTP/1.1 Jul 13 21:10:59.714573 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept: application/json Jul 13 21:10:59.714573 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept-Encoding: identity Jul 13 21:10:59.714573 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Connection: close Jul 13 21:10:59.714573 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Length: 74 Jul 13 21:10:59.714573 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Type: application/json Jul 13 21:10:59.714573 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Host: 10.222.0.39 Jul 13 21:10:59.714573 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Openstack-System-Scope: None Jul 13 21:10:59.714573 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: User-Agent: python-urllib3/1.26.9 Jul 13 21:10:59.714573 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Auth-Token: gAAAAABizzNqbt1i7chwFPcQAba6b9dk7TD8_G2l_XT7jQopf9IFAZNKmztmBJ4IISK_ds_GpyDLtbYZUS7JtctAPU-Tk1Sa5a4_tbywXB6GjEvdott7LmC4oiwINlLKkOc-EI-NfdeC0sCeq7QrJd1h1pR8691UeSBeFVmfqq10_09s26cRblc Jul 13 21:10:59.714573 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Id: None Jul 13 21:10:59.714573 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Name: None Jul 13 21:10:59.714573 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Identity-Status: Confirmed Jul 13 21:10:59.714573 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Is-Admin-Project: True Jul 13 21:10:59.714573 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Id: default Jul 13 21:10:59.714573 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Name: Default Jul 13 21:10:59.714573 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Id: 0a2703a8b75043e0ab0656482fa9ddeb Jul 13 21:10:59.714573 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Name: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:10:59.714573 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Role: member,reader Jul 13 21:10:59.714573 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Roles: member,reader Jul 13 21:10:59.716002 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a2703a8b75043e0ab0656482fa9ddeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0a2703a8b75043e0ab0656482fa9ddeb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0a2703a8b75043e0ab0656482fa9ddeb", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a2703a8b75043e0ab0656482fa9ddeb"}]}] Jul 13 21:10:59.716002 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:10:59.716002 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Id: 0a2703a8b75043e0ab0656482fa9ddeb Jul 13 21:10:59.716002 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:10:59.716002 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User: tempest-AttachVolumeNegativeTest-334916766-project Jul 13 21:10:59.716002 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Id: default Jul 13 21:10:59.716002 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Name: Default Jul 13 21:10:59.716002 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Id: d9cab6f67cd34c46886d036ba170331e Jul 13 21:10:59.716002 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Name: tempest-AttachVolumeNegativeTest-334916766-project Jul 13 21:10:59.716002 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Jul 13 21:10:59.716002 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: {"volumeAttachment": {"volumeId": "83d3f6e3-7c40-4e17-ab1d-b04484673266"}} Jul 13 21:10:59.716002 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: method: > Jul 13 21:10:59.716831 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: exception: Invalid volume: volume 83d3f6e3-7c40-4e17-ab1d-b04484673266 is already attached to instances: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f Jul 13 21:10:59.716831 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: action_args: {'server_id': '8a127418-a227-4cf6-a36c-822265e0b11f', 'body': {'volumeAttachment': {'volumeId': '83d3f6e3-7c40-4e17-ab1d-b04484673266'}}} Jul 13 21:10:59.716831 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:10:59.716831 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:10:59.716831 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 13 21:10:59.716831 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 13 21:10:59.716831 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 13 21:10:59.716831 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 13 21:10:59.716831 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 13 21:10:59.716831 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 13 21:10:59.716831 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 13 21:10:59.716831 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 13 21:10:59.716831 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 13 21:10:59.716831 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 13 21:10:59.716831 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 83d3f6e3-7c40-4e17-ab1d-b04484673266 is already attached to instances: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f Jul 13 21:10:59.716831 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:10:59.716831 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:10:59.716831 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:10:59.716831 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:10:59.718281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:10:59.718281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:10:59.718281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:10:59.718281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:10:59.718281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:10:59.718281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:10:59.718281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 13 21:10:59.718281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 13 21:10:59.718281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 13 21:10:59.718281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 13 21:10:59.718281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 13 21:10:59.718281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 13 21:10:59.718281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 13 21:10:59.718281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 13 21:10:59.718281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 83d3f6e3-7c40-4e17-ab1d-b04484673266 is already attached to instances: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f Jul 13 21:10:59.718281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:10:59.718281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:10:59.718281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:10:59.718281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:10:59.718281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:10:59.719840 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:10:59.719840 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:10:59.719840 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:10:59.719840 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 83d3f6e3-7c40-4e17-ab1d-b04484673266 is already attached to instances: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f Jul 13 21:10:59.719840 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:10:59.719840 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-c39f0c78-d51a-4e1a-923a-c7e1754e79cd tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Returning 400 to user: Invalid volume: volume 83d3f6e3-7c40-4e17-ab1d-b04484673266 is already attached to instances: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f {{(pid=118444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:10:59.719840 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-c39f0c78-d51a-4e1a-923a-c7e1754e79cd tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "POST /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093381 Jul 13 21:10:59.719840 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 384/775] 10.222.0.39 () {60 vars in 1322 bytes} [Wed Jul 13 21:10:59 2022] POST /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 13 21:10:59.724740 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-19467094-334d-4518-965b-112c4988cbbf tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:59.725226 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-19467094-334d-4518-965b-112c4988cbbf tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:59.731173 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-19467094-334d-4518-965b-112c4988cbbf tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:59.731612 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-19467094-334d-4518-965b-112c4988cbbf tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:59.732360 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-19467094-334d-4518-965b-112c4988cbbf tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:59.732785 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-19467094-334d-4518-965b-112c4988cbbf tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:59.756471 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-19467094-334d-4518-965b-112c4988cbbf tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Going to try to terminate instance {{(pid=118445) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 21:10:59.840523 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-19467094-334d-4518-965b-112c4988cbbf tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 204 len: 0 microversion: 2.1 time: 0.119098 Jul 13 21:10:59.841116 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 392/776] 10.222.0.39 () {58 vars in 1238 bytes} [Wed Jul 13 21:10:59 2022] DELETE /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 21:10:59.849038 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-a63ed782-974f-460b-b321-a5c81622e412 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:10:59.849629 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-a63ed782-974f-460b-b321-a5c81622e412 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:10:59.856492 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a63ed782-974f-460b-b321-a5c81622e412 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:59.856949 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a63ed782-974f-460b-b321-a5c81622e412 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:59.857706 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a63ed782-974f-460b-b321-a5c81622e412 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:10:59.858146 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a63ed782-974f-460b-b321-a5c81622e412 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:10:59.981488 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-a63ed782-974f-460b-b321-a5c81622e412 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:10:59.988796 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-a63ed782-974f-460b-b321-a5c81622e412 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1683 microversion: 2.1 time: 0.143527 Jul 13 21:10:59.989365 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 385/777] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:10:59 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1683 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:00.339242 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-fe95e006-372a-4ff0-8c38-494bbcb3c7da tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:00.340180 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-fe95e006-372a-4ff0-8c38-494bbcb3c7da tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:00.346148 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-fe95e006-372a-4ff0-8c38-494bbcb3c7da tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:00.346585 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-fe95e006-372a-4ff0-8c38-494bbcb3c7da tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:00.347373 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-fe95e006-372a-4ff0-8c38-494bbcb3c7da tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:00.347798 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-fe95e006-372a-4ff0-8c38-494bbcb3c7da tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:00.477319 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-fe95e006-372a-4ff0-8c38-494bbcb3c7da tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:00.484715 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-fe95e006-372a-4ff0-8c38-494bbcb3c7da tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1677 microversion: 2.1 time: 0.149643 Jul 13 21:11:00.485266 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 393/778] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:00 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:01.005958 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-2597d5c5-859c-4ff5-8d31-23eb605cb28e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:01.006570 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-2597d5c5-859c-4ff5-8d31-23eb605cb28e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:01.013186 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2597d5c5-859c-4ff5-8d31-23eb605cb28e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:01.013646 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2597d5c5-859c-4ff5-8d31-23eb605cb28e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:01.014683 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2597d5c5-859c-4ff5-8d31-23eb605cb28e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:01.015124 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2597d5c5-859c-4ff5-8d31-23eb605cb28e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:01.148144 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-2597d5c5-859c-4ff5-8d31-23eb605cb28e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:01.155574 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-2597d5c5-859c-4ff5-8d31-23eb605cb28e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1683 microversion: 2.1 time: 0.153402 Jul 13 21:11:01.156145 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 386/779] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:01 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:01.502609 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-987f2e1d-a8f9-4555-8554-01bb0a40390b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:01.503245 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-987f2e1d-a8f9-4555-8554-01bb0a40390b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:01.510242 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-987f2e1d-a8f9-4555-8554-01bb0a40390b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:01.510834 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-987f2e1d-a8f9-4555-8554-01bb0a40390b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:01.511645 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-987f2e1d-a8f9-4555-8554-01bb0a40390b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:01.512078 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-987f2e1d-a8f9-4555-8554-01bb0a40390b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:01.644105 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-987f2e1d-a8f9-4555-8554-01bb0a40390b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:01.651860 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-987f2e1d-a8f9-4555-8554-01bb0a40390b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1677 microversion: 2.1 time: 0.153208 Jul 13 21:11:01.652436 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 394/780] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:01 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:02.172352 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-af06ce9b-e1a0-49f4-892f-ad95fcb257a9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:02.172959 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-af06ce9b-e1a0-49f4-892f-ad95fcb257a9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:02.180172 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-af06ce9b-e1a0-49f4-892f-ad95fcb257a9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:02.180620 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-af06ce9b-e1a0-49f4-892f-ad95fcb257a9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:02.181380 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-af06ce9b-e1a0-49f4-892f-ad95fcb257a9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:02.181817 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-af06ce9b-e1a0-49f4-892f-ad95fcb257a9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:02.407132 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-af06ce9b-e1a0-49f4-892f-ad95fcb257a9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:02.415175 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-af06ce9b-e1a0-49f4-892f-ad95fcb257a9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1683 microversion: 2.1 time: 0.246611 Jul 13 21:11:02.415734 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 387/781] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:02 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1683 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:02.669114 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-8c74e751-b0fa-46d7-8270-59de0d8e92f9 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:02.669721 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8c74e751-b0fa-46d7-8270-59de0d8e92f9 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:02.676252 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8c74e751-b0fa-46d7-8270-59de0d8e92f9 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:02.676691 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8c74e751-b0fa-46d7-8270-59de0d8e92f9 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:02.677461 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8c74e751-b0fa-46d7-8270-59de0d8e92f9 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:02.677898 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8c74e751-b0fa-46d7-8270-59de0d8e92f9 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:02.815224 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8c74e751-b0fa-46d7-8270-59de0d8e92f9 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:02.823841 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-8c74e751-b0fa-46d7-8270-59de0d8e92f9 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1677 microversion: 2.1 time: 0.158516 Jul 13 21:11:02.824567 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 395/782] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:02 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:03.154975 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-13ccf471-f83b-4de5-bcb5-3f389b15d1fe req-14fde679-0a05-42e8-82a2-6b2db6e5008b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a127418-a227-4cf6-a36c-822265e0b11f", "name": "network-vif-deleted", "tag": "4db6331d-2b48-476c-a5bb-5ae20a91bf9d"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:11:03.165083 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-13ccf471-f83b-4de5-bcb5-3f389b15d1fe req-14fde679-0a05-42e8-82a2-6b2db6e5008b service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:03.167732 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-13ccf471-f83b-4de5-bcb5-3f389b15d1fe req-14fde679-0a05-42e8-82a2-6b2db6e5008b service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:03.182753 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-13ccf471-f83b-4de5-bcb5-3f389b15d1fe req-14fde679-0a05-42e8-82a2-6b2db6e5008b service nova] Creating event network-vif-deleted:4db6331d-2b48-476c-a5bb-5ae20a91bf9d for instance 8a127418-a227-4cf6-a36c-822265e0b11f on hv-cinder-79987 Jul 13 21:11:03.187426 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-13ccf471-f83b-4de5-bcb5-3f389b15d1fe req-14fde679-0a05-42e8-82a2-6b2db6e5008b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114862 Jul 13 21:11:03.188019 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 388/783] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:11:03.434381 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-a8f109c5-e827-45cd-b14e-33f50caa6e21 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:03.435029 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-a8f109c5-e827-45cd-b14e-33f50caa6e21 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:03.441015 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a8f109c5-e827-45cd-b14e-33f50caa6e21 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:03.441459 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a8f109c5-e827-45cd-b14e-33f50caa6e21 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:03.442210 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a8f109c5-e827-45cd-b14e-33f50caa6e21 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:03.442658 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a8f109c5-e827-45cd-b14e-33f50caa6e21 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:03.472684 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a8f109c5-e827-45cd-b14e-33f50caa6e21 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:03.473147 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a8f109c5-e827-45cd-b14e-33f50caa6e21 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:03.473570 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.objects.instance [None req-a8f109c5-e827-45cd-b14e-33f50caa6e21 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lazy-loading 'fault' on Instance uuid 8a127418-a227-4cf6-a36c-822265e0b11f {{(pid=118445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:11:03.514288 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-a8f109c5-e827-45cd-b14e-33f50caa6e21 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:03.521619 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-a8f109c5-e827-45cd-b14e-33f50caa6e21 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 200 len: 1332 microversion: 2.1 time: 0.091056 Jul 13 21:11:03.522178 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 396/784] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:03 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 1332 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:03.841730 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-73c46c99-2bc1-46f4-85ab-bc98755aee4c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:03.842425 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-73c46c99-2bc1-46f4-85ab-bc98755aee4c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:03.850382 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-73c46c99-2bc1-46f4-85ab-bc98755aee4c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:03.850970 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-73c46c99-2bc1-46f4-85ab-bc98755aee4c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:03.851842 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-73c46c99-2bc1-46f4-85ab-bc98755aee4c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:03.852351 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-73c46c99-2bc1-46f4-85ab-bc98755aee4c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:03.990822 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-73c46c99-2bc1-46f4-85ab-bc98755aee4c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:03.999679 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-73c46c99-2bc1-46f4-85ab-bc98755aee4c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1677 microversion: 2.1 time: 0.162046 Jul 13 21:11:04.000271 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 389/785] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:03 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:11:04.538907 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-91a3a957-526c-45da-9b82-98f2d71085b5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:04.539489 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-91a3a957-526c-45da-9b82-98f2d71085b5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:04.545976 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-91a3a957-526c-45da-9b82-98f2d71085b5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:04.546423 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-91a3a957-526c-45da-9b82-98f2d71085b5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:04.547204 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-91a3a957-526c-45da-9b82-98f2d71085b5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:04.547633 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-91a3a957-526c-45da-9b82-98f2d71085b5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:04.562744 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.wsgi [None req-91a3a957-526c-45da-9b82-98f2d71085b5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] HTTP exception thrown: Instance 8a127418-a227-4cf6-a36c-822265e0b11f could not be found. Jul 13 21:11:04.564446 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-91a3a957-526c-45da-9b82-98f2d71085b5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Request method failure captured: Jul 13 21:11:04.564446 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: request: GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f HTTP/1.1 Jul 13 21:11:04.564446 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept: application/json Jul 13 21:11:04.564446 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept-Encoding: identity Jul 13 21:11:04.564446 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Connection: close Jul 13 21:11:04.564446 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Length: 0 Jul 13 21:11:04.564446 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Type: application/json Jul 13 21:11:04.564446 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Host: 10.222.0.39 Jul 13 21:11:04.564446 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Openstack-System-Scope: None Jul 13 21:11:04.564446 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: User-Agent: python-urllib3/1.26.9 Jul 13 21:11:04.564446 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Auth-Token: gAAAAABizzNqbt1i7chwFPcQAba6b9dk7TD8_G2l_XT7jQopf9IFAZNKmztmBJ4IISK_ds_GpyDLtbYZUS7JtctAPU-Tk1Sa5a4_tbywXB6GjEvdott7LmC4oiwINlLKkOc-EI-NfdeC0sCeq7QrJd1h1pR8691UeSBeFVmfqq10_09s26cRblc Jul 13 21:11:04.564446 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Id: None Jul 13 21:11:04.564446 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Name: None Jul 13 21:11:04.564446 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Identity-Status: Confirmed Jul 13 21:11:04.564446 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Is-Admin-Project: True Jul 13 21:11:04.564446 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Id: default Jul 13 21:11:04.564446 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Name: Default Jul 13 21:11:04.564446 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Id: 0a2703a8b75043e0ab0656482fa9ddeb Jul 13 21:11:04.564446 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Name: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:11:04.564446 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Role: member,reader Jul 13 21:11:04.564446 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Roles: member,reader Jul 13 21:11:04.565765 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a2703a8b75043e0ab0656482fa9ddeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0a2703a8b75043e0ab0656482fa9ddeb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0a2703a8b75043e0ab0656482fa9ddeb", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a2703a8b75043e0ab0656482fa9ddeb"}]}] Jul 13 21:11:04.565765 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:11:04.565765 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Id: 0a2703a8b75043e0ab0656482fa9ddeb Jul 13 21:11:04.565765 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:11:04.565765 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User: tempest-AttachVolumeNegativeTest-334916766-project Jul 13 21:11:04.565765 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Id: default Jul 13 21:11:04.565765 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Name: Default Jul 13 21:11:04.565765 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Id: d9cab6f67cd34c46886d036ba170331e Jul 13 21:11:04.565765 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Name: tempest-AttachVolumeNegativeTest-334916766-project Jul 13 21:11:04.565765 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: method: > Jul 13 21:11:04.565765 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: exception: Instance 8a127418-a227-4cf6-a36c-822265e0b11f could not be found. Jul 13 21:11:04.565765 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: action_args: {'id': '8a127418-a227-4cf6-a36c-822265e0b11f'} Jul 13 21:11:04.566498 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:11:04.566498 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:11:04.566498 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:11:04.566498 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:11:04.566498 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:11:04.566498 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:11:04.566498 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:11:04.566498 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:11:04.566498 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:11:04.566498 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:11:04.566498 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a127418-a227-4cf6-a36c-822265e0b11f could not be found. Jul 13 21:11:04.566498 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:11:04.566498 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:11:04.566498 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:11:04.566498 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:11:04.566498 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:11:04.566498 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:11:04.566498 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:11:04.566498 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:11:04.566498 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:11:04.568207 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:11:04.568207 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 21:11:04.568207 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 21:11:04.568207 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:11:04.568207 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:11:04.568207 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:11:04.568207 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:11:04.568207 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a127418-a227-4cf6-a36c-822265e0b11f could not be found. Jul 13 21:11:04.568207 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:11:04.568207 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:11:04.568207 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:11:04.568207 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:11:04.568207 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:11:04.568207 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:11:04.568207 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:11:04.568207 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:11:04.568207 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a127418-a227-4cf6-a36c-822265e0b11f could not be found. Jul 13 21:11:04.568207 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:11:04.569954 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-91a3a957-526c-45da-9b82-98f2d71085b5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Returning 404 to user: Instance 8a127418-a227-4cf6-a36c-822265e0b11f could not be found. {{(pid=118445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:11:04.569954 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-91a3a957-526c-45da-9b82-98f2d71085b5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 404 len: 111 microversion: 2.1 time: 0.031019 Jul 13 21:11:04.570794 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 397/786] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:04 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:11:04.575834 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-2565b96d-ffca-46d2-830f-740d556b7321 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '.version_select at 0x7f96e86238b0>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:04.579147 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2565b96d-ffca-46d2-830f-740d556b7321 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [66125711-6262-4271-b047-84abb5a6707c] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 13 21:11:05.016927 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-b9a6abb7-5e7b-4e44-8d01-d4b9c8a9996c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:05.017567 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-b9a6abb7-5e7b-4e44-8d01-d4b9c8a9996c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:05.023608 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b9a6abb7-5e7b-4e44-8d01-d4b9c8a9996c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:05.024054 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b9a6abb7-5e7b-4e44-8d01-d4b9c8a9996c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:05.024812 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b9a6abb7-5e7b-4e44-8d01-d4b9c8a9996c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:05.025247 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b9a6abb7-5e7b-4e44-8d01-d4b9c8a9996c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:05.157351 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b9a6abb7-5e7b-4e44-8d01-d4b9c8a9996c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:05.165299 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-b9a6abb7-5e7b-4e44-8d01-d4b9c8a9996c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1677 microversion: 2.1 time: 0.152620 Jul 13 21:11:05.165858 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 398/787] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:05 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:11:05.586916 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO oslo.messaging._drivers.impl_rabbit [None req-2565b96d-ffca-46d2-830f-740d556b7321 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [66125711-6262-4271-b047-84abb5a6707c] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 49820. Jul 13 21:11:05.605146 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-2565b96d-ffca-46d2-830f-740d556b7321 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1784408147" status: 202 len: 0 microversion: 2.1 time: 1.033226 Jul 13 21:11:05.605718 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 390/788] 10.222.0.39 () {58 vars in 1220 bytes} [Wed Jul 13 21:11:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1784408147 => generated 0 bytes in 1034 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 21:11:06.183467 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ed2f7910-db6d-4b79-93cb-021deedc2bc7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:06.184156 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ed2f7910-db6d-4b79-93cb-021deedc2bc7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:06.190881 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ed2f7910-db6d-4b79-93cb-021deedc2bc7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:06.191329 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ed2f7910-db6d-4b79-93cb-021deedc2bc7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:06.192272 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ed2f7910-db6d-4b79-93cb-021deedc2bc7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:06.192702 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ed2f7910-db6d-4b79-93cb-021deedc2bc7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:06.240590 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-da166305-e596-4a1d-85d2-cf969d1c49fc tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:06.241612 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-da166305-e596-4a1d-85d2-cf969d1c49fc tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:06.248046 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-da166305-e596-4a1d-85d2-cf969d1c49fc tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:06.248488 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-da166305-e596-4a1d-85d2-cf969d1c49fc tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:06.249241 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-da166305-e596-4a1d-85d2-cf969d1c49fc tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:06.249676 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-da166305-e596-4a1d-85d2-cf969d1c49fc tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:06.321865 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ed2f7910-db6d-4b79-93cb-021deedc2bc7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:06.329439 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.objects.instance [None req-da166305-e596-4a1d-85d2-cf969d1c49fc tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lazy-loading 'services' on Instance uuid 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f {{(pid=118444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:11:06.329634 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ed2f7910-db6d-4b79-93cb-021deedc2bc7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1677 microversion: 2.1 time: 0.150979 Jul 13 21:11:06.330193 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 399/789] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:06 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:06.398596 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-da166305-e596-4a1d-85d2-cf969d1c49fc tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "DELETE /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f/os-volume_attachments/83d3f6e3-7c40-4e17-ab1d-b04484673266" status: 202 len: 0 microversion: 2.1 time: 0.161725 Jul 13 21:11:06.399210 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 391/790] 10.222.0.39 () {58 vars in 1415 bytes} [Wed Jul 13 21:11:06 2022] DELETE /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f/os-volume_attachments/83d3f6e3-7c40-4e17-ab1d-b04484673266 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 13 21:11:06.407874 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-e1e7e086-15a8-45dc-95d0-97d7a8c4ac8a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:06.408861 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-e1e7e086-15a8-45dc-95d0-97d7a8c4ac8a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:06.415583 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e1e7e086-15a8-45dc-95d0-97d7a8c4ac8a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:06.416050 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e1e7e086-15a8-45dc-95d0-97d7a8c4ac8a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:06.416837 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e1e7e086-15a8-45dc-95d0-97d7a8c4ac8a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:06.417265 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e1e7e086-15a8-45dc-95d0-97d7a8c4ac8a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:06.446226 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-e1e7e086-15a8-45dc-95d0-97d7a8c4ac8a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042258 Jul 13 21:11:06.446806 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 400/791] 10.222.0.39 () {58 vars in 1301 bytes} [Wed Jul 13 21:11:06 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:11:07.347962 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-fa8fe03b-3dad-467d-b729-ffc9f5b49ead tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:07.348660 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-fa8fe03b-3dad-467d-b729-ffc9f5b49ead tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:07.356135 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fa8fe03b-3dad-467d-b729-ffc9f5b49ead tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:07.356580 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fa8fe03b-3dad-467d-b729-ffc9f5b49ead tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:07.357368 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fa8fe03b-3dad-467d-b729-ffc9f5b49ead tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:07.358551 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fa8fe03b-3dad-467d-b729-ffc9f5b49ead tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:07.465248 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-91369cae-83dc-413b-ab93-61afb5593a93 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:07.466183 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-91369cae-83dc-413b-ab93-61afb5593a93 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:07.472710 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-91369cae-83dc-413b-ab93-61afb5593a93 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:07.473158 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-91369cae-83dc-413b-ab93-61afb5593a93 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:07.473923 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-91369cae-83dc-413b-ab93-61afb5593a93 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:07.474362 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-91369cae-83dc-413b-ab93-61afb5593a93 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:07.497876 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-fa8fe03b-3dad-467d-b729-ffc9f5b49ead tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:07.509058 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-fa8fe03b-3dad-467d-b729-ffc9f5b49ead tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1677 microversion: 2.1 time: 0.165540 Jul 13 21:11:07.509644 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 392/792] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:07 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:07.515175 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-91369cae-83dc-413b-ab93-61afb5593a93 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055457 Jul 13 21:11:07.515740 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 401/793] 10.222.0.39 () {58 vars in 1301 bytes} [Wed Jul 13 21:11:07 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 13 21:11:07.571440 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-3a61703f-e1ec-4082-abbf-883ed5df509b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:07.571929 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-3a61703f-e1ec-4082-abbf-883ed5df509b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:07.577764 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3a61703f-e1ec-4082-abbf-883ed5df509b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:07.578203 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3a61703f-e1ec-4082-abbf-883ed5df509b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:07.579007 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3a61703f-e1ec-4082-abbf-883ed5df509b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:07.579438 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3a61703f-e1ec-4082-abbf-883ed5df509b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:07.603970 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-3a61703f-e1ec-4082-abbf-883ed5df509b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Going to try to terminate instance {{(pid=118444) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 21:11:07.677723 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-3a61703f-e1ec-4082-abbf-883ed5df509b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "DELETE /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 204 len: 0 microversion: 2.1 time: 0.110381 Jul 13 21:11:07.678321 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 393/794] 10.222.0.39 () {58 vars in 1238 bytes} [Wed Jul 13 21:11:07 2022] DELETE /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 21:11:07.686684 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-10129757-f82a-44d8-bfbb-fac407097fb0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:07.687294 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-10129757-f82a-44d8-bfbb-fac407097fb0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:07.693286 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-10129757-f82a-44d8-bfbb-fac407097fb0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:07.693732 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-10129757-f82a-44d8-bfbb-fac407097fb0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:07.694506 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-10129757-f82a-44d8-bfbb-fac407097fb0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:07.694970 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-10129757-f82a-44d8-bfbb-fac407097fb0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:07.823019 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-10129757-f82a-44d8-bfbb-fac407097fb0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:07.830451 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-10129757-f82a-44d8-bfbb-fac407097fb0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1680 microversion: 2.1 time: 0.147774 Jul 13 21:11:07.831051 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 402/795] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:07 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:11:08.527105 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b1a234e6-0ec4-4534-a140-dc2790c8e6dd tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:08.527839 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b1a234e6-0ec4-4534-a140-dc2790c8e6dd tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:08.534271 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b1a234e6-0ec4-4534-a140-dc2790c8e6dd tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:08.534757 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b1a234e6-0ec4-4534-a140-dc2790c8e6dd tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:08.535513 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b1a234e6-0ec4-4534-a140-dc2790c8e6dd tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:08.535945 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b1a234e6-0ec4-4534-a140-dc2790c8e6dd tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:08.672951 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b1a234e6-0ec4-4534-a140-dc2790c8e6dd tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:08.681073 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b1a234e6-0ec4-4534-a140-dc2790c8e6dd tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1677 microversion: 2.1 time: 0.158142 Jul 13 21:11:08.681641 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 394/796] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:08 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:08.847261 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-6d79d976-5f6e-4d68-a41d-13f6518ca892 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:08.847816 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-6d79d976-5f6e-4d68-a41d-13f6518ca892 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:08.855124 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6d79d976-5f6e-4d68-a41d-13f6518ca892 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:08.855567 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6d79d976-5f6e-4d68-a41d-13f6518ca892 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:08.856336 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6d79d976-5f6e-4d68-a41d-13f6518ca892 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:08.856768 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6d79d976-5f6e-4d68-a41d-13f6518ca892 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:08.984091 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-6d79d976-5f6e-4d68-a41d-13f6518ca892 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:08.987625 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:11:08.992222 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-6d79d976-5f6e-4d68-a41d-13f6518ca892 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1680 microversion: 2.1 time: 0.148839 Jul 13 21:11:08.992886 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 403/797] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:08 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:09.648012 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-94e6641e-3f49-40af-9ad2-2cf7494c69b9 req-92fd3a88-b0ae-4f37-8ce2-7b9990e0f029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52701d54-bab0-4fd7-b5c1-1b0e433d4c9f", "name": "network-vif-deleted", "tag": "38f6480c-0bdd-4309-9b91-2e38a86a5d27"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:11:09.662462 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-94e6641e-3f49-40af-9ad2-2cf7494c69b9 req-92fd3a88-b0ae-4f37-8ce2-7b9990e0f029 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:09.662904 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-94e6641e-3f49-40af-9ad2-2cf7494c69b9 req-92fd3a88-b0ae-4f37-8ce2-7b9990e0f029 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:09.674243 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-94e6641e-3f49-40af-9ad2-2cf7494c69b9 req-92fd3a88-b0ae-4f37-8ce2-7b9990e0f029 service nova] Creating event network-vif-deleted:38f6480c-0bdd-4309-9b91-2e38a86a5d27 for instance 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f on hv-cinder-79987 Jul 13 21:11:09.679432 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-94e6641e-3f49-40af-9ad2-2cf7494c69b9 req-92fd3a88-b0ae-4f37-8ce2-7b9990e0f029 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035575 Jul 13 21:11:09.680017 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 395/798] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:11:09.698999 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-eb7ff503-2558-4b12-ba66-c90ed9b653cb tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:09.699655 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-eb7ff503-2558-4b12-ba66-c90ed9b653cb tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:09.707969 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-eb7ff503-2558-4b12-ba66-c90ed9b653cb tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:09.708627 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-eb7ff503-2558-4b12-ba66-c90ed9b653cb tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:09.709620 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-eb7ff503-2558-4b12-ba66-c90ed9b653cb tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:09.714272 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-eb7ff503-2558-4b12-ba66-c90ed9b653cb tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:09.877700 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-eb7ff503-2558-4b12-ba66-c90ed9b653cb tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:09.886510 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-eb7ff503-2558-4b12-ba66-c90ed9b653cb tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1677 microversion: 2.1 time: 0.192246 Jul 13 21:11:09.887121 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 404/799] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:09 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1677 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:10.009844 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-31d31b32-83db-4638-a91b-5089adcecc44 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:10.010533 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-31d31b32-83db-4638-a91b-5089adcecc44 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:10.017065 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-31d31b32-83db-4638-a91b-5089adcecc44 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:10.017515 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-31d31b32-83db-4638-a91b-5089adcecc44 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:10.018275 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-31d31b32-83db-4638-a91b-5089adcecc44 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:10.018739 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-31d31b32-83db-4638-a91b-5089adcecc44 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:10.049734 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-31d31b32-83db-4638-a91b-5089adcecc44 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:10.050212 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-31d31b32-83db-4638-a91b-5089adcecc44 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:10.050688 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.objects.instance [None req-31d31b32-83db-4638-a91b-5089adcecc44 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lazy-loading 'fault' on Instance uuid 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f {{(pid=118444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:11:10.096233 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-31d31b32-83db-4638-a91b-5089adcecc44 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:10.105014 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-31d31b32-83db-4638-a91b-5089adcecc44 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 200 len: 1331 microversion: 2.1 time: 0.099708 Jul 13 21:11:10.105608 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 396/800] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:10 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:10.904057 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-6c1b25e0-e85c-4581-94eb-ee11e5358fef tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:10.904836 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-6c1b25e0-e85c-4581-94eb-ee11e5358fef tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:10.911311 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6c1b25e0-e85c-4581-94eb-ee11e5358fef tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:10.911766 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6c1b25e0-e85c-4581-94eb-ee11e5358fef tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:10.913023 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6c1b25e0-e85c-4581-94eb-ee11e5358fef tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:10.914104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6c1b25e0-e85c-4581-94eb-ee11e5358fef tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:11.039658 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-6c1b25e0-e85c-4581-94eb-ee11e5358fef tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:11.047032 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-6c1b25e0-e85c-4581-94eb-ee11e5358fef tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1677 microversion: 2.1 time: 0.146855 Jul 13 21:11:11.047595 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 405/801] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:10 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:11.123004 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b39c574f-bf9c-4706-a3ee-b421e6751754 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:11.123606 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b39c574f-bf9c-4706-a3ee-b421e6751754 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:11.130092 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b39c574f-bf9c-4706-a3ee-b421e6751754 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:11.130542 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b39c574f-bf9c-4706-a3ee-b421e6751754 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:11.131355 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b39c574f-bf9c-4706-a3ee-b421e6751754 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:11.131792 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b39c574f-bf9c-4706-a3ee-b421e6751754 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:11.135843 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:11:11.145974 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.wsgi [None req-b39c574f-bf9c-4706-a3ee-b421e6751754 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] HTTP exception thrown: Instance 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f could not be found. Jul 13 21:11:11.148200 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b39c574f-bf9c-4706-a3ee-b421e6751754 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Request method failure captured: Jul 13 21:11:11.148200 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: request: GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f HTTP/1.1 Jul 13 21:11:11.148200 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept: application/json Jul 13 21:11:11.148200 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept-Encoding: identity Jul 13 21:11:11.148200 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Connection: close Jul 13 21:11:11.148200 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Length: 0 Jul 13 21:11:11.148200 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Type: application/json Jul 13 21:11:11.148200 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Host: 10.222.0.39 Jul 13 21:11:11.148200 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Openstack-System-Scope: None Jul 13 21:11:11.148200 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: User-Agent: python-urllib3/1.26.9 Jul 13 21:11:11.148200 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Auth-Token: gAAAAABizzNqbt1i7chwFPcQAba6b9dk7TD8_G2l_XT7jQopf9IFAZNKmztmBJ4IISK_ds_GpyDLtbYZUS7JtctAPU-Tk1Sa5a4_tbywXB6GjEvdott7LmC4oiwINlLKkOc-EI-NfdeC0sCeq7QrJd1h1pR8691UeSBeFVmfqq10_09s26cRblc Jul 13 21:11:11.148200 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Id: None Jul 13 21:11:11.148200 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Name: None Jul 13 21:11:11.148200 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Identity-Status: Confirmed Jul 13 21:11:11.148200 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Is-Admin-Project: True Jul 13 21:11:11.148200 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Id: default Jul 13 21:11:11.148200 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Name: Default Jul 13 21:11:11.148200 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Id: 0a2703a8b75043e0ab0656482fa9ddeb Jul 13 21:11:11.148200 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Name: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:11:11.148200 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Role: member,reader Jul 13 21:11:11.148200 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Roles: member,reader Jul 13 21:11:11.149735 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a2703a8b75043e0ab0656482fa9ddeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0a2703a8b75043e0ab0656482fa9ddeb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0a2703a8b75043e0ab0656482fa9ddeb", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a2703a8b75043e0ab0656482fa9ddeb"}]}] Jul 13 21:11:11.149735 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:11:11.149735 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Id: 0a2703a8b75043e0ab0656482fa9ddeb Jul 13 21:11:11.149735 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:11:11.149735 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User: tempest-AttachVolumeNegativeTest-334916766-project Jul 13 21:11:11.149735 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Id: default Jul 13 21:11:11.149735 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Name: Default Jul 13 21:11:11.149735 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Id: d9cab6f67cd34c46886d036ba170331e Jul 13 21:11:11.149735 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Name: tempest-AttachVolumeNegativeTest-334916766-project Jul 13 21:11:11.149735 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: method: > Jul 13 21:11:11.149735 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: exception: Instance 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f could not be found. Jul 13 21:11:11.149735 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: action_args: {'id': '52701d54-bab0-4fd7-b5c1-1b0e433d4c9f'} Jul 13 21:11:11.150685 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:11:11.150685 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:11:11.150685 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:11:11.150685 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:11:11.150685 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:11:11.150685 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:11:11.150685 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:11:11.150685 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:11:11.150685 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:11:11.150685 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:11:11.150685 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f could not be found. Jul 13 21:11:11.150685 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:11:11.150685 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:11:11.150685 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:11:11.150685 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:11:11.150685 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:11:11.150685 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:11:11.150685 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:11:11.150685 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:11:11.150685 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:11:11.152116 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:11:11.152116 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 21:11:11.152116 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 21:11:11.152116 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:11:11.152116 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:11:11.152116 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:11:11.152116 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:11:11.152116 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f could not be found. Jul 13 21:11:11.152116 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:11:11.152116 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:11:11.152116 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:11:11.152116 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:11:11.152116 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:11:11.152116 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:11:11.152116 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:11:11.152116 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:11:11.152116 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f could not be found. Jul 13 21:11:11.152116 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:11:11.153455 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b39c574f-bf9c-4706-a3ee-b421e6751754 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Returning 404 to user: Instance 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f could not be found. {{(pid=118444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:11:11.153455 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b39c574f-bf9c-4706-a3ee-b421e6751754 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 404 len: 111 microversion: 2.1 time: 0.030424 Jul 13 21:11:11.153455 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 397/802] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:11 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:11:11.158448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-cf0618df-8d64-42c9-8480-1bd99ecdd817 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '.version_select at 0x7f96e85d1790>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:11.176758 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-cf0618df-8d64-42c9-8480-1bd99ecdd817 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-113640619" status: 202 len: 0 microversion: 2.1 time: 0.022067 Jul 13 21:11:11.177299 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 406/803] 10.222.0.39 () {58 vars in 1217 bytes} [Wed Jul 13 21:11:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-113640619 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 21:11:11.751071 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-2a54cfea-c0cc-4af9-afd6-6f3cdbb6b894 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Action: 'create', calling method: .version_select at 0x7f96e868e430>, body: {"keypair": {"name": "tempest-keypair-22635791", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtenlCLeYw0qmp6nxoCEB78N4JMasoNNuFpQaPtgXqg6QRgtkc2tqrH7ulwMo+MoOSV02j2jPaYBGRPfgrG3s7R929a565CkgrpIgSNR3ZPEKBRzauJkBnXbU4a0XQvSQ=="}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:11:11.766557 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.quota [None req-2a54cfea-c0cc-4af9-afd6-6f3cdbb6b894 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Getting quotas for project 0a2703a8b75043e0ab0656482fa9ddeb. Resources: {'key_pairs'} {{(pid=118444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:11:11.770397 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.quota [None req-2a54cfea-c0cc-4af9-afd6-6f3cdbb6b894 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Getting quotas for user d9cab6f67cd34c46886d036ba170331e and project 0a2703a8b75043e0ab0656482fa9ddeb. Resources: {'key_pairs'} {{(pid=118444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:11:11.792043 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-2a54cfea-c0cc-4af9-afd6-6f3cdbb6b894 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.045202 Jul 13 21:11:11.792618 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 398/804] 10.222.0.39 () {60 vars in 1158 bytes} [Wed Jul 13 21:11:11 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:11:12.065859 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-6fe0a0b5-589e-4b44-9f9d-7c0b34112ff5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:12.066500 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-6fe0a0b5-589e-4b44-9f9d-7c0b34112ff5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:12.073100 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6fe0a0b5-589e-4b44-9f9d-7c0b34112ff5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:12.073552 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6fe0a0b5-589e-4b44-9f9d-7c0b34112ff5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:12.074329 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6fe0a0b5-589e-4b44-9f9d-7c0b34112ff5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:12.074800 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6fe0a0b5-589e-4b44-9f9d-7c0b34112ff5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:12.210033 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-6fe0a0b5-589e-4b44-9f9d-7c0b34112ff5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:12.217671 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-6fe0a0b5-589e-4b44-9f9d-7c0b34112ff5 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1677 microversion: 2.1 time: 0.156349 Jul 13 21:11:12.218244 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 407/805] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:12 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:11:13.010728 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-362e6cd8-750d-4ed3-b119-bfe7e600ad38 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1992287540", "imageRef": "5a995c88-d784-4a51-a6b9-25aa9dfe607c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0724e09-98b0-4f74-b483-93b3266239e7"}], "security_groups": [{"name": "tempest-securitygroup--1471217558"}], "key_name": "tempest-keypair-22635791", "user_data": "}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:11:13.113516 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.network.neutron [None req-362e6cd8-750d-4ed3-b119-bfe7e600ad38 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] validate_networks() for [('b0724e09-98b0-4f74-b483-93b3266239e7', None, None, None, None, None)] {{(pid=118444) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 21:11:13.234389 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-3ecf74e9-85a2-4d97-9b21-f240c3fede79 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:13.235357 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-3ecf74e9-85a2-4d97-9b21-f240c3fede79 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:13.242344 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3ecf74e9-85a2-4d97-9b21-f240c3fede79 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:13.242830 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3ecf74e9-85a2-4d97-9b21-f240c3fede79 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:13.243587 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3ecf74e9-85a2-4d97-9b21-f240c3fede79 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:13.244014 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3ecf74e9-85a2-4d97-9b21-f240c3fede79 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:13.371423 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3ecf74e9-85a2-4d97-9b21-f240c3fede79 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:13.379394 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-3ecf74e9-85a2-4d97-9b21-f240c3fede79 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1677 microversion: 2.1 time: 0.148806 Jul 13 21:11:13.380049 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 408/806] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:13 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:11:13.576415 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.virt.hardware [None req-362e6cd8-750d-4ed3-b119-bfe7e600ad38 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Flavor limits 0:0:0 {{(pid=118444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 21:11:13.576884 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.virt.hardware [None req-362e6cd8-750d-4ed3-b119-bfe7e600ad38 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Image limits 0:0:0 {{(pid=118444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 21:11:13.577351 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.virt.hardware [None req-362e6cd8-750d-4ed3-b119-bfe7e600ad38 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Flavor pref 0:0:0 {{(pid=118444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 21:11:13.577756 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.virt.hardware [None req-362e6cd8-750d-4ed3-b119-bfe7e600ad38 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Image pref 0:0:0 {{(pid=118444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 21:11:13.578160 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.virt.hardware [None req-362e6cd8-750d-4ed3-b119-bfe7e600ad38 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 21:11:13.587387 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-362e6cd8-750d-4ed3-b119-bfe7e600ad38 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:13.587829 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-362e6cd8-750d-4ed3-b119-bfe7e600ad38 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:13.588613 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-362e6cd8-750d-4ed3-b119-bfe7e600ad38 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:13.589041 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-362e6cd8-750d-4ed3-b119-bfe7e600ad38 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:13.605483 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.quota [None req-362e6cd8-750d-4ed3-b119-bfe7e600ad38 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Getting quotas for project 0a2703a8b75043e0ab0656482fa9ddeb. Resources: {'cores', 'instances', 'ram'} {{(pid=118444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:11:13.609430 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.quota [None req-362e6cd8-750d-4ed3-b119-bfe7e600ad38 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Getting quotas for user d9cab6f67cd34c46886d036ba170331e and project 0a2703a8b75043e0ab0656482fa9ddeb. Resources: {'cores', 'instances', 'ram'} {{(pid=118444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:11:13.620501 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-362e6cd8-750d-4ed3-b119-bfe7e600ad38 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Going to run 1 instances... {{(pid=118444) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 21:11:13.622873 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-362e6cd8-750d-4ed3-b119-bfe7e600ad38 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995c88-d784-4a51-a6b9-25aa9dfe607c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 21:11:13.669973 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-362e6cd8-750d-4ed3-b119-bfe7e600ad38 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.664662 Jul 13 21:11:13.670988 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 399/807] 10.222.0.39 () {60 vars in 1146 bytes} [Wed Jul 13 21:11:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 21:11:13.680667 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-cfad0a6f-41ba-4283-b68c-3392de022f78 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:13.681261 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-cfad0a6f-41ba-4283-b68c-3392de022f78 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:13.735429 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-cfad0a6f-41ba-4283-b68c-3392de022f78 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:13.742288 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-cfad0a6f-41ba-4283-b68c-3392de022f78 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2" status: 200 len: 1240 microversion: 2.1 time: 0.065430 Jul 13 21:11:13.743015 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 409/808] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:13 2022] GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2 => generated 1240 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:14.397649 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0b535b4f-5af5-4ed6-a652-bc107c5fd239 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:14.398411 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-0b535b4f-5af5-4ed6-a652-bc107c5fd239 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:14.404824 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0b535b4f-5af5-4ed6-a652-bc107c5fd239 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:14.405274 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0b535b4f-5af5-4ed6-a652-bc107c5fd239 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:14.406040 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0b535b4f-5af5-4ed6-a652-bc107c5fd239 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:14.406483 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0b535b4f-5af5-4ed6-a652-bc107c5fd239 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:14.537129 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-0b535b4f-5af5-4ed6-a652-bc107c5fd239 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:14.545041 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-0b535b4f-5af5-4ed6-a652-bc107c5fd239 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1654 microversion: 2.1 time: 0.152068 Jul 13 21:11:14.545605 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 400/809] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:14 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1654 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:14.561890 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-d4469f5b-b8e7-4cd0-97ea-02b1cb431219 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:11:14.568446 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d4469f5b-b8e7-4cd0-97ea-02b1cb431219 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:14.568895 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d4469f5b-b8e7-4cd0-97ea-02b1cb431219 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:14.592617 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-d4469f5b-b8e7-4cd0-97ea-02b1cb431219 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Going to try to start instance {{(pid=118445) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 13 21:11:14.633765 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-d4469f5b-b8e7-4cd0-97ea-02b1cb431219 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "POST /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153/action" status: 202 len: 0 microversion: 2.1 time: 0.075583 Jul 13 21:11:14.634701 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 410/810] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Jul 13 21:11:14 2022] POST /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 21:11:14.643027 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-77edff03-0c35-42ab-ab8b-c08b1d65f1df tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:14.643668 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-77edff03-0c35-42ab-ab8b-c08b1d65f1df tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:14.649604 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-77edff03-0c35-42ab-ab8b-c08b1d65f1df tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:14.650051 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-77edff03-0c35-42ab-ab8b-c08b1d65f1df tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:14.650839 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-77edff03-0c35-42ab-ab8b-c08b1d65f1df tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:14.651278 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-77edff03-0c35-42ab-ab8b-c08b1d65f1df tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:14.759909 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-66171861-cae1-4eae-856f-b06b43c48c61 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:14.760859 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-66171861-cae1-4eae-856f-b06b43c48c61 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:14.769580 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-66171861-cae1-4eae-856f-b06b43c48c61 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:14.770510 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-66171861-cae1-4eae-856f-b06b43c48c61 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:14.775066 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-66171861-cae1-4eae-856f-b06b43c48c61 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:14.775529 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-66171861-cae1-4eae-856f-b06b43c48c61 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:14.791038 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-77edff03-0c35-42ab-ab8b-c08b1d65f1df tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:14.799930 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-77edff03-0c35-42ab-ab8b-c08b1d65f1df tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1663 microversion: 2.1 time: 0.160631 Jul 13 21:11:14.800544 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 401/811] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:14 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1663 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:11:14.848951 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-66171861-cae1-4eae-856f-b06b43c48c61 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:14.869792 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-66171861-cae1-4eae-856f-b06b43c48c61 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2" status: 200 len: 1292 microversion: 2.1 time: 0.111325 Jul 13 21:11:14.871002 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 411/812] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:14 2022] GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2 => generated 1292 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:11:15.817827 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-24dd0b92-085a-4ec5-ba66-99f55308ab00 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:15.818522 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-24dd0b92-085a-4ec5-ba66-99f55308ab00 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:15.825516 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-24dd0b92-085a-4ec5-ba66-99f55308ab00 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:15.826038 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-24dd0b92-085a-4ec5-ba66-99f55308ab00 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:15.826881 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-24dd0b92-085a-4ec5-ba66-99f55308ab00 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:15.827379 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-24dd0b92-085a-4ec5-ba66-99f55308ab00 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:15.888024 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-520905b2-a539-4142-8f72-921367d81459 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:15.889093 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-520905b2-a539-4142-8f72-921367d81459 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:15.895619 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-520905b2-a539-4142-8f72-921367d81459 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:15.896058 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-520905b2-a539-4142-8f72-921367d81459 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:15.896816 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-520905b2-a539-4142-8f72-921367d81459 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:15.897246 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-520905b2-a539-4142-8f72-921367d81459 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:16.036689 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-520905b2-a539-4142-8f72-921367d81459 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:16.045057 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-520905b2-a539-4142-8f72-921367d81459 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2" status: 200 len: 1366 microversion: 2.1 time: 0.160949 Jul 13 21:11:16.045653 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 412/813] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:15 2022] GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:11:16.302823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-24dd0b92-085a-4ec5-ba66-99f55308ab00 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:16.312562 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-24dd0b92-085a-4ec5-ba66-99f55308ab00 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1663 microversion: 2.1 time: 0.498097 Jul 13 21:11:16.313192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 402/814] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:15 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1663 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:17.063003 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-52fce4c7-b383-49dd-82b0-8fbd1f28e6e8 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:17.063548 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-52fce4c7-b383-49dd-82b0-8fbd1f28e6e8 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:17.070427 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-52fce4c7-b383-49dd-82b0-8fbd1f28e6e8 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:17.070917 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-52fce4c7-b383-49dd-82b0-8fbd1f28e6e8 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:17.071672 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-52fce4c7-b383-49dd-82b0-8fbd1f28e6e8 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:17.072101 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-52fce4c7-b383-49dd-82b0-8fbd1f28e6e8 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:17.214456 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-52fce4c7-b383-49dd-82b0-8fbd1f28e6e8 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:17.223429 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-52fce4c7-b383-49dd-82b0-8fbd1f28e6e8 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2" status: 200 len: 1366 microversion: 2.1 time: 0.164194 Jul 13 21:11:17.224643 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 413/815] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:17 2022] GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:17.331577 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-131e647b-c1e0-45fa-9cec-4028cb54252d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:17.332305 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-131e647b-c1e0-45fa-9cec-4028cb54252d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:17.340398 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-131e647b-c1e0-45fa-9cec-4028cb54252d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:17.340853 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-131e647b-c1e0-45fa-9cec-4028cb54252d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:17.341619 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-131e647b-c1e0-45fa-9cec-4028cb54252d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:17.342055 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-131e647b-c1e0-45fa-9cec-4028cb54252d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:17.392962 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-24636085-acac-436b-98c8-d473b1261fea req-0f833088-919e-4df5-8b78-c99581998075 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "823dc842-377a-4438-a1c5-73b5cce4cda2", "tag": "4d6adae4-d0db-4e04-bfb6-7912631d40c4"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:11:17.412812 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-24636085-acac-436b-98c8-d473b1261fea req-0f833088-919e-4df5-8b78-c99581998075 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:17.413352 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-24636085-acac-436b-98c8-d473b1261fea req-0f833088-919e-4df5-8b78-c99581998075 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:17.425623 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-24636085-acac-436b-98c8-d473b1261fea req-0f833088-919e-4df5-8b78-c99581998075 service nova] Creating event network-changed:4d6adae4-d0db-4e04-bfb6-7912631d40c4 for instance 823dc842-377a-4438-a1c5-73b5cce4cda2 on hv-cinder-79987 Jul 13 21:11:17.432239 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-24636085-acac-436b-98c8-d473b1261fea req-0f833088-919e-4df5-8b78-c99581998075 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051417 Jul 13 21:11:17.435712 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 414/816] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:11:17.544013 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-131e647b-c1e0-45fa-9cec-4028cb54252d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:17.552130 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-131e647b-c1e0-45fa-9cec-4028cb54252d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1667 microversion: 2.1 time: 0.225235 Jul 13 21:11:17.552909 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 403/817] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:17 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1667 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:18.240760 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-2f6bba80-1a68-472c-8014-0004ff70d42e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:18.241445 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-2f6bba80-1a68-472c-8014-0004ff70d42e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:18.247662 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2f6bba80-1a68-472c-8014-0004ff70d42e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:18.248112 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2f6bba80-1a68-472c-8014-0004ff70d42e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:18.248872 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2f6bba80-1a68-472c-8014-0004ff70d42e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:18.249311 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2f6bba80-1a68-472c-8014-0004ff70d42e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:18.377289 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-2f6bba80-1a68-472c-8014-0004ff70d42e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:18.385043 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-2f6bba80-1a68-472c-8014-0004ff70d42e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2" status: 200 len: 1366 microversion: 2.1 time: 0.149060 Jul 13 21:11:18.385601 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 415/818] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:18 2022] GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:19.402545 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-61f364c4-3611-4f3c-a5fd-49b2cd8a1d91 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:19.403179 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-61f364c4-3611-4f3c-a5fd-49b2cd8a1d91 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:19.409623 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-61f364c4-3611-4f3c-a5fd-49b2cd8a1d91 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:19.410073 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-61f364c4-3611-4f3c-a5fd-49b2cd8a1d91 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:19.410860 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-61f364c4-3611-4f3c-a5fd-49b2cd8a1d91 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:19.411295 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-61f364c4-3611-4f3c-a5fd-49b2cd8a1d91 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:19.534902 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-61f364c4-3611-4f3c-a5fd-49b2cd8a1d91 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:19.542779 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-61f364c4-3611-4f3c-a5fd-49b2cd8a1d91 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2" status: 200 len: 1366 microversion: 2.1 time: 0.143991 Jul 13 21:11:19.543343 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 404/819] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:19 2022] GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:20.559895 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-86ed3bef-f40d-45db-8f25-a0ee8058ce9d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:20.560406 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-86ed3bef-f40d-45db-8f25-a0ee8058ce9d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:20.567673 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-86ed3bef-f40d-45db-8f25-a0ee8058ce9d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:20.568123 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-86ed3bef-f40d-45db-8f25-a0ee8058ce9d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:20.568886 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-86ed3bef-f40d-45db-8f25-a0ee8058ce9d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:20.569349 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-86ed3bef-f40d-45db-8f25-a0ee8058ce9d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:20.697879 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-86ed3bef-f40d-45db-8f25-a0ee8058ce9d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:20.705366 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-86ed3bef-f40d-45db-8f25-a0ee8058ce9d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2" status: 200 len: 1366 microversion: 2.1 time: 0.149436 Jul 13 21:11:20.705931 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 416/820] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:20 2022] GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:21.721177 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-099d1cd4-e7ed-4c08-ae1f-f5276a4fcc37 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:21.721993 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-099d1cd4-e7ed-4c08-ae1f-f5276a4fcc37 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:21.728535 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-099d1cd4-e7ed-4c08-ae1f-f5276a4fcc37 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:21.728982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-099d1cd4-e7ed-4c08-ae1f-f5276a4fcc37 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:21.729738 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-099d1cd4-e7ed-4c08-ae1f-f5276a4fcc37 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:21.730173 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-099d1cd4-e7ed-4c08-ae1f-f5276a4fcc37 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:21.858509 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-099d1cd4-e7ed-4c08-ae1f-f5276a4fcc37 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:21.865860 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-099d1cd4-e7ed-4c08-ae1f-f5276a4fcc37 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2" status: 200 len: 1366 microversion: 2.1 time: 0.148473 Jul 13 21:11:21.866941 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 405/821] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:21 2022] GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:22.882976 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-b66398ed-e251-4e8c-8507-55e33f776861 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:22.883570 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-b66398ed-e251-4e8c-8507-55e33f776861 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:22.890166 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b66398ed-e251-4e8c-8507-55e33f776861 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:22.890604 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b66398ed-e251-4e8c-8507-55e33f776861 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:22.891378 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b66398ed-e251-4e8c-8507-55e33f776861 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:22.891800 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b66398ed-e251-4e8c-8507-55e33f776861 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:23.017428 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b66398ed-e251-4e8c-8507-55e33f776861 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:23.025175 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-b66398ed-e251-4e8c-8507-55e33f776861 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2" status: 200 len: 1366 microversion: 2.1 time: 0.146569 Jul 13 21:11:23.025721 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 417/822] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:22 2022] GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:24.042113 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-4241c7a1-0b4b-45d5-84ac-a138d7c42af4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:24.042761 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-4241c7a1-0b4b-45d5-84ac-a138d7c42af4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:24.044597 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell0:SELECT=2 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:11:24.045254 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell0:SELECT=10 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:11:24.051678 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4241c7a1-0b4b-45d5-84ac-a138d7c42af4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:24.052130 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4241c7a1-0b4b-45d5-84ac-a138d7c42af4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:24.052902 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4241c7a1-0b4b-45d5-84ac-a138d7c42af4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:24.053342 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4241c7a1-0b4b-45d5-84ac-a138d7c42af4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:24.181542 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-4241c7a1-0b4b-45d5-84ac-a138d7c42af4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:24.188867 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-4241c7a1-0b4b-45d5-84ac-a138d7c42af4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2" status: 200 len: 1366 microversion: 2.1 time: 0.151361 Jul 13 21:11:24.189430 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 406/823] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:24 2022] GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:25.204628 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-380b66dc-37c2-42a3-8e43-5451154308d4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:25.205229 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-380b66dc-37c2-42a3-8e43-5451154308d4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:25.207230 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=2 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:11:25.213783 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-380b66dc-37c2-42a3-8e43-5451154308d4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:25.214266 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-380b66dc-37c2-42a3-8e43-5451154308d4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:25.215120 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-380b66dc-37c2-42a3-8e43-5451154308d4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:25.215614 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-380b66dc-37c2-42a3-8e43-5451154308d4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:25.349399 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-380b66dc-37c2-42a3-8e43-5451154308d4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:25.357637 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-380b66dc-37c2-42a3-8e43-5451154308d4 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2" status: 200 len: 1366 microversion: 2.1 time: 0.156855 Jul 13 21:11:25.358391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 418/824] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:25 2022] GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:25.400561 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-265e0912-3614-4d9c-999e-4be921b18105 req-2e1d8889-5d07-452c-93e3-83a0048392dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "823dc842-377a-4438-a1c5-73b5cce4cda2", "name": "network-vif-plugged", "status": "completed", "tag": "4d6adae4-d0db-4e04-bfb6-7912631d40c4"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:11:25.408917 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-265e0912-3614-4d9c-999e-4be921b18105 req-2e1d8889-5d07-452c-93e3-83a0048392dc service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:25.409361 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-265e0912-3614-4d9c-999e-4be921b18105 req-2e1d8889-5d07-452c-93e3-83a0048392dc service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:25.420502 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-265e0912-3614-4d9c-999e-4be921b18105 req-2e1d8889-5d07-452c-93e3-83a0048392dc service nova] Creating event network-vif-plugged:4d6adae4-d0db-4e04-bfb6-7912631d40c4 for instance 823dc842-377a-4438-a1c5-73b5cce4cda2 on hv-cinder-79987 Jul 13 21:11:25.425332 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-265e0912-3614-4d9c-999e-4be921b18105 req-2e1d8889-5d07-452c-93e3-83a0048392dc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100516 Jul 13 21:11:25.425921 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 407/825] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:11:26.374838 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-a8344d01-1245-49e4-90be-6fe929304107 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:26.375433 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-a8344d01-1245-49e4-90be-6fe929304107 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:26.377714 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:11:26.382963 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a8344d01-1245-49e4-90be-6fe929304107 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:26.383404 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a8344d01-1245-49e4-90be-6fe929304107 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:26.384155 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a8344d01-1245-49e4-90be-6fe929304107 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:26.384583 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a8344d01-1245-49e4-90be-6fe929304107 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:26.511729 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-a8344d01-1245-49e4-90be-6fe929304107 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:26.519562 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-a8344d01-1245-49e4-90be-6fe929304107 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2" status: 200 len: 1366 microversion: 2.1 time: 0.148580 Jul 13 21:11:26.520121 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 419/826] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:26 2022] GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:27.539154 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-69611f46-6950-459e-82a6-aacccb4936b6 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:27.539775 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-69611f46-6950-459e-82a6-aacccb4936b6 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:27.546029 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-69611f46-6950-459e-82a6-aacccb4936b6 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:27.546480 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-69611f46-6950-459e-82a6-aacccb4936b6 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:27.547316 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-69611f46-6950-459e-82a6-aacccb4936b6 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:27.547752 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-69611f46-6950-459e-82a6-aacccb4936b6 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:27.680797 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-69611f46-6950-459e-82a6-aacccb4936b6 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:27.688619 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-69611f46-6950-459e-82a6-aacccb4936b6 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2" status: 200 len: 1366 microversion: 2.1 time: 0.155290 Jul 13 21:11:27.689401 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 408/827] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:27 2022] GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:28.072207 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-6d201c88-ccd8-4ba8-914e-779494e3d3d6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:28.072733 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-6d201c88-ccd8-4ba8-914e-779494e3d3d6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:28.078895 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6d201c88-ccd8-4ba8-914e-779494e3d3d6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:28.079337 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6d201c88-ccd8-4ba8-914e-779494e3d3d6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:28.080100 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6d201c88-ccd8-4ba8-914e-779494e3d3d6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:28.080533 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6d201c88-ccd8-4ba8-914e-779494e3d3d6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:28.108048 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-6d201c88-ccd8-4ba8-914e-779494e3d3d6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f/os-volume_attachments/d8b1464c-146a-4fd3-b394-795f5011e0dc" status: 200 len: 194 microversion: 2.20 time: 0.040503 Jul 13 21:11:28.108615 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 420/828] 10.222.0.39 () {60 vars in 1453 bytes} [Wed Jul 13 21:11:28 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f/os-volume_attachments/d8b1464c-146a-4fd3-b394-795f5011e0dc => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 21:11:28.171753 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-1be13f37-aaf4-41f8-ac0b-b9ca5b89f84c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:28.172239 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-1be13f37-aaf4-41f8-ac0b-b9ca5b89f84c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:28.174194 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:11:28.179516 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1be13f37-aaf4-41f8-ac0b-b9ca5b89f84c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:28.179954 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1be13f37-aaf4-41f8-ac0b-b9ca5b89f84c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:28.180699 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1be13f37-aaf4-41f8-ac0b-b9ca5b89f84c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:28.181128 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1be13f37-aaf4-41f8-ac0b-b9ca5b89f84c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:28.260792 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.objects.instance [None req-1be13f37-aaf4-41f8-ac0b-b9ca5b89f84c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lazy-loading 'services' on Instance uuid 12316d28-2975-4c1e-b05b-82a3253bb35f {{(pid=118444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:11:28.330471 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-1be13f37-aaf4-41f8-ac0b-b9ca5b89f84c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "DELETE /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f/os-volume_attachments/d8b1464c-146a-4fd3-b394-795f5011e0dc" status: 202 len: 0 microversion: 2.20 time: 0.164064 Jul 13 21:11:28.331499 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 409/829] 10.222.0.39 () {60 vars in 1456 bytes} [Wed Jul 13 21:11:28 2022] DELETE /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f/os-volume_attachments/d8b1464c-146a-4fd3-b394-795f5011e0dc => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 13 21:11:28.340423 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-89ff0c16-2abf-45ba-8998-588b442f0571 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:28.341335 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-89ff0c16-2abf-45ba-8998-588b442f0571 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:28.347233 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-89ff0c16-2abf-45ba-8998-588b442f0571 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:28.347673 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-89ff0c16-2abf-45ba-8998-588b442f0571 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:28.348418 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-89ff0c16-2abf-45ba-8998-588b442f0571 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:28.348847 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-89ff0c16-2abf-45ba-8998-588b442f0571 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:28.376819 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-89ff0c16-2abf-45ba-8998-588b442f0571 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040351 Jul 13 21:11:28.377338 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 421/830] 10.222.0.39 () {60 vars in 1342 bytes} [Wed Jul 13 21:11:28 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 21:11:28.705763 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-c404af6f-0d50-4c54-ba61-a20b79f7ad64 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:28.706449 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-c404af6f-0d50-4c54-ba61-a20b79f7ad64 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:28.713219 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c404af6f-0d50-4c54-ba61-a20b79f7ad64 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:28.713660 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c404af6f-0d50-4c54-ba61-a20b79f7ad64 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:28.714406 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c404af6f-0d50-4c54-ba61-a20b79f7ad64 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:28.714863 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c404af6f-0d50-4c54-ba61-a20b79f7ad64 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:28.841484 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-c404af6f-0d50-4c54-ba61-a20b79f7ad64 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:28.848823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-c404af6f-0d50-4c54-ba61-a20b79f7ad64 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2" status: 200 len: 1555 microversion: 2.1 time: 0.147244 Jul 13 21:11:28.849395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 410/831] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:28 2022] GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2 => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:28.867055 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ebc6aa06-58a1-4bcb-8258-faf888f34be5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:28.867542 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ebc6aa06-58a1-4bcb-8258-faf888f34be5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:28.873474 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ebc6aa06-58a1-4bcb-8258-faf888f34be5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:28.873916 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ebc6aa06-58a1-4bcb-8258-faf888f34be5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:28.874695 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ebc6aa06-58a1-4bcb-8258-faf888f34be5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:28.875131 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ebc6aa06-58a1-4bcb-8258-faf888f34be5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:28.878713 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:11:28.955069 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ebc6aa06-58a1-4bcb-8258-faf888f34be5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092395 Jul 13 21:11:28.955677 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 422/832] 10.222.0.39 () {58 vars in 1274 bytes} [Wed Jul 13 21:11:28 2022] GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:11:29.388555 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-80e03ae9-4df3-4f47-b87f-4109e6710542 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:29.389524 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-80e03ae9-4df3-4f47-b87f-4109e6710542 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:29.395749 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-80e03ae9-4df3-4f47-b87f-4109e6710542 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:29.396197 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-80e03ae9-4df3-4f47-b87f-4109e6710542 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:29.396956 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-80e03ae9-4df3-4f47-b87f-4109e6710542 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:29.397882 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-80e03ae9-4df3-4f47-b87f-4109e6710542 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:29.427556 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-80e03ae9-4df3-4f47-b87f-4109e6710542 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043042 Jul 13 21:11:29.428149 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 411/833] 10.222.0.39 () {60 vars in 1342 bytes} [Wed Jul 13 21:11:29 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 21:11:30.154532 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-b4d99b03-e74f-474a-bf4a-6beed6d9b749 req-21590148-39c8-4f5b-8b54-d646dc886c17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "823dc842-377a-4438-a1c5-73b5cce4cda2", "tag": "4d6adae4-d0db-4e04-bfb6-7912631d40c4"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:11:30.162432 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-b4d99b03-e74f-474a-bf4a-6beed6d9b749 req-21590148-39c8-4f5b-8b54-d646dc886c17 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:30.162905 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-b4d99b03-e74f-474a-bf4a-6beed6d9b749 req-21590148-39c8-4f5b-8b54-d646dc886c17 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:30.173640 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-b4d99b03-e74f-474a-bf4a-6beed6d9b749 req-21590148-39c8-4f5b-8b54-d646dc886c17 service nova] Creating event network-changed:4d6adae4-d0db-4e04-bfb6-7912631d40c4 for instance 823dc842-377a-4438-a1c5-73b5cce4cda2 on hv-cinder-79987 Jul 13 21:11:30.179127 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-b4d99b03-e74f-474a-bf4a-6beed6d9b749 req-21590148-39c8-4f5b-8b54-d646dc886c17 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081346 Jul 13 21:11:30.179708 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 423/834] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:11:30.439265 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b8e6d110-0180-481a-bb5a-7456dd270812 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:30.440218 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b8e6d110-0180-481a-bb5a-7456dd270812 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:30.446942 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b8e6d110-0180-481a-bb5a-7456dd270812 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:30.447395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b8e6d110-0180-481a-bb5a-7456dd270812 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:30.448173 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b8e6d110-0180-481a-bb5a-7456dd270812 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:30.448613 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b8e6d110-0180-481a-bb5a-7456dd270812 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:30.478281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b8e6d110-0180-481a-bb5a-7456dd270812 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042891 Jul 13 21:11:30.479055 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 412/835] 10.222.0.39 () {60 vars in 1342 bytes} [Wed Jul 13 21:11:30 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:30.539456 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-e850b46b-7e51-4a39-88f0-b6e4f224e40d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:30.540189 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-e850b46b-7e51-4a39-88f0-b6e4f224e40d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:30.546531 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e850b46b-7e51-4a39-88f0-b6e4f224e40d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:30.547013 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e850b46b-7e51-4a39-88f0-b6e4f224e40d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:30.547773 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e850b46b-7e51-4a39-88f0-b6e4f224e40d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:30.548198 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e850b46b-7e51-4a39-88f0-b6e4f224e40d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:30.575025 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-e850b46b-7e51-4a39-88f0-b6e4f224e40d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Going to try to terminate instance {{(pid=118445) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 21:11:30.659688 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-e850b46b-7e51-4a39-88f0-b6e4f224e40d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "DELETE /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 204 len: 0 microversion: 2.20 time: 0.124668 Jul 13 21:11:30.661238 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 424/836] 10.222.0.39 () {60 vars in 1279 bytes} [Wed Jul 13 21:11:30 2022] DELETE /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 13 21:11:30.670084 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-e198bd37-bf7b-4569-8d40-b06666a9d475 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:30.670907 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-e198bd37-bf7b-4569-8d40-b06666a9d475 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:30.677047 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e198bd37-bf7b-4569-8d40-b06666a9d475 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:30.677575 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e198bd37-bf7b-4569-8d40-b06666a9d475 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:30.678401 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e198bd37-bf7b-4569-8d40-b06666a9d475 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:30.678961 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e198bd37-bf7b-4569-8d40-b06666a9d475 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:30.852309 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-e198bd37-bf7b-4569-8d40-b06666a9d475 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:30.860797 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-e198bd37-bf7b-4569-8d40-b06666a9d475 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:30.862285 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-e198bd37-bf7b-4569-8d40-b06666a9d475 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:30.863484 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-e198bd37-bf7b-4569-8d40-b06666a9d475 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1723 microversion: 2.20 time: 0.197385 Jul 13 21:11:30.864038 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 413/837] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:11:30 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:11:31.881762 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-7d87adfd-5ad3-4985-aa80-ff384b2426dc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:31.882444 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-7d87adfd-5ad3-4985-aa80-ff384b2426dc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:31.889348 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7d87adfd-5ad3-4985-aa80-ff384b2426dc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:31.889816 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7d87adfd-5ad3-4985-aa80-ff384b2426dc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:31.890564 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7d87adfd-5ad3-4985-aa80-ff384b2426dc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:31.891020 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7d87adfd-5ad3-4985-aa80-ff384b2426dc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:32.019847 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-7d87adfd-5ad3-4985-aa80-ff384b2426dc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:32.027949 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-7d87adfd-5ad3-4985-aa80-ff384b2426dc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:32.029498 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-7d87adfd-5ad3-4985-aa80-ff384b2426dc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:32.030641 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-7d87adfd-5ad3-4985-aa80-ff384b2426dc tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1723 microversion: 2.20 time: 0.153103 Jul 13 21:11:32.031213 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 425/838] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:11:31 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:11:33.049768 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-a3b93bd5-d22e-4fd9-9a21-3db0498e362d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:33.050445 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-a3b93bd5-d22e-4fd9-9a21-3db0498e362d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:33.057687 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a3b93bd5-d22e-4fd9-9a21-3db0498e362d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:33.058137 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a3b93bd5-d22e-4fd9-9a21-3db0498e362d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:33.058948 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a3b93bd5-d22e-4fd9-9a21-3db0498e362d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:33.059388 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a3b93bd5-d22e-4fd9-9a21-3db0498e362d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:33.304313 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-a3b93bd5-d22e-4fd9-9a21-3db0498e362d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:33.312237 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-a3b93bd5-d22e-4fd9-9a21-3db0498e362d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:33.313872 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-a3b93bd5-d22e-4fd9-9a21-3db0498e362d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:33.315153 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-a3b93bd5-d22e-4fd9-9a21-3db0498e362d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1723 microversion: 2.20 time: 0.269334 Jul 13 21:11:33.315724 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 414/839] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:11:33 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:11:33.325311 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-77fd88fe-d6e9-4d67-b1b7-446a09ce0e40 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2298f029-a8b0-4a44-80eb-4ce54b0aac99"}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:11:33.326422 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-77fd88fe-d6e9-4d67-b1b7-446a09ce0e40 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:33.333113 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-77fd88fe-d6e9-4d67-b1b7-446a09ce0e40 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:33.333559 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-77fd88fe-d6e9-4d67-b1b7-446a09ce0e40 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:33.334332 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-77fd88fe-d6e9-4d67-b1b7-446a09ce0e40 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:33.334801 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-77fd88fe-d6e9-4d67-b1b7-446a09ce0e40 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:33.612364 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-77fd88fe-d6e9-4d67-b1b7-446a09ce0e40 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "POST /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290776 Jul 13 21:11:33.613024 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 426/840] 10.222.0.39 () {60 vars in 1322 bytes} [Wed Jul 13 21:11:33 2022] POST /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:11:33.777581 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-c0be8209-3090-4e36-a525-dcf7ad1a4e92 req-f62a6134-5c8a-47c9-9d3c-e3ca99a2b2ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12316d28-2975-4c1e-b05b-82a3253bb35f", "name": "network-vif-deleted", "tag": "8d927002-4a46-4df8-b48a-c6cb84decd8d"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:11:33.785476 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-c0be8209-3090-4e36-a525-dcf7ad1a4e92 req-f62a6134-5c8a-47c9-9d3c-e3ca99a2b2ec service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:33.786239 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-c0be8209-3090-4e36-a525-dcf7ad1a4e92 req-f62a6134-5c8a-47c9-9d3c-e3ca99a2b2ec service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:33.801194 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-c0be8209-3090-4e36-a525-dcf7ad1a4e92 req-f62a6134-5c8a-47c9-9d3c-e3ca99a2b2ec service nova] Creating event network-vif-deleted:8d927002-4a46-4df8-b48a-c6cb84decd8d for instance 12316d28-2975-4c1e-b05b-82a3253bb35f on hv-cinder-79987 Jul 13 21:11:33.806583 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-c0be8209-3090-4e36-a525-dcf7ad1a4e92 req-f62a6134-5c8a-47c9-9d3c-e3ca99a2b2ec service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032564 Jul 13 21:11:33.807559 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 415/841] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:11:34.336002 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ebbb8022-790e-4008-bbf3-5f68636572fe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:34.336727 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ebbb8022-790e-4008-bbf3-5f68636572fe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:34.343902 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ebbb8022-790e-4008-bbf3-5f68636572fe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:34.344767 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ebbb8022-790e-4008-bbf3-5f68636572fe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:34.345872 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ebbb8022-790e-4008-bbf3-5f68636572fe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:34.346513 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ebbb8022-790e-4008-bbf3-5f68636572fe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:34.379448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ebbb8022-790e-4008-bbf3-5f68636572fe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:34.380183 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ebbb8022-790e-4008-bbf3-5f68636572fe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:34.380643 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.objects.instance [None req-ebbb8022-790e-4008-bbf3-5f68636572fe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lazy-loading 'fault' on Instance uuid 12316d28-2975-4c1e-b05b-82a3253bb35f {{(pid=118445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:11:34.440699 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ebbb8022-790e-4008-bbf3-5f68636572fe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:34.450415 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ebbb8022-790e-4008-bbf3-5f68636572fe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:34.452112 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ebbb8022-790e-4008-bbf3-5f68636572fe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:34.453316 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ebbb8022-790e-4008-bbf3-5f68636572fe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 200 len: 1370 microversion: 2.20 time: 0.122796 Jul 13 21:11:34.453895 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 427/842] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:11:34 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 1370 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:11:35.472537 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0e3a7d99-0961-4406-a222-31d96783b277 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:35.473239 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-0e3a7d99-0961-4406-a222-31d96783b277 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:35.480127 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0e3a7d99-0961-4406-a222-31d96783b277 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:35.480578 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0e3a7d99-0961-4406-a222-31d96783b277 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:35.481331 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0e3a7d99-0961-4406-a222-31d96783b277 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:35.481769 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0e3a7d99-0961-4406-a222-31d96783b277 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:35.494604 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.wsgi [None req-0e3a7d99-0961-4406-a222-31d96783b277 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] HTTP exception thrown: Instance 12316d28-2975-4c1e-b05b-82a3253bb35f could not be found. Jul 13 21:11:35.496214 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0e3a7d99-0961-4406-a222-31d96783b277 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Request method failure captured: Jul 13 21:11:35.496214 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: request: GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f HTTP/1.1 Jul 13 21:11:35.496214 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept: application/json Jul 13 21:11:35.496214 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept-Encoding: identity Jul 13 21:11:35.496214 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Connection: close Jul 13 21:11:35.496214 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Length: 0 Jul 13 21:11:35.496214 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Type: application/json Jul 13 21:11:35.496214 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Host: 10.222.0.39 Jul 13 21:11:35.496214 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Openstack-System-Scope: None Jul 13 21:11:35.496214 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: User-Agent: python-urllib3/1.26.9 Jul 13 21:11:35.496214 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Auth-Token: gAAAAABizzNvSRu2b2ZpqIR4KbSCswRIDfFdSsj05xGSoupc9NAJHPqB6oS742DGj4-GuWgK-i-D6b8poG5uP5GlFTjUKIltlWKbOQCr1styYXhRbx3uotGCYoUsbLOHE_SuQ1w5LXS67zCuZB2MDNSeGT3uNHuiqy_zDIgYzHPQbPFUM4hUkOs Jul 13 21:11:35.496214 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Id: None Jul 13 21:11:35.496214 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Name: None Jul 13 21:11:35.496214 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Identity-Status: Confirmed Jul 13 21:11:35.496214 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Is-Admin-Project: True Jul 13 21:11:35.496214 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Openstack-Nova-Api-Version: 2.20 Jul 13 21:11:35.496214 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Id: default Jul 13 21:11:35.496214 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Name: Default Jul 13 21:11:35.496214 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Id: e43ca8a5c9f2494fbb9c5c5509c5c79b Jul 13 21:11:35.496214 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2097802904 Jul 13 21:11:35.496214 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Role: member,reader Jul 13 21:11:35.496214 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Roles: member,reader Jul 13 21:11:35.497848 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e43ca8a5c9f2494fbb9c5c5509c5c79b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e43ca8a5c9f2494fbb9c5c5509c5c79b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e43ca8a5c9f2494fbb9c5c5509c5c79b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e43ca8a5c9f2494fbb9c5c5509c5c79b"}]}] Jul 13 21:11:35.497848 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2097802904 Jul 13 21:11:35.497848 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Id: e43ca8a5c9f2494fbb9c5c5509c5c79b Jul 13 21:11:35.497848 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2097802904 Jul 13 21:11:35.497848 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User: tempest-AttachVolumeShelveTestJSON-2097802904-project Jul 13 21:11:35.497848 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Id: default Jul 13 21:11:35.497848 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Name: Default Jul 13 21:11:35.497848 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Id: 0884a33a47e448e7826f257880a28964 Jul 13 21:11:35.497848 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2097802904-project Jul 13 21:11:35.497848 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: method: > Jul 13 21:11:35.497848 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: exception: Instance 12316d28-2975-4c1e-b05b-82a3253bb35f could not be found. Jul 13 21:11:35.497848 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: action_args: {'id': '12316d28-2975-4c1e-b05b-82a3253bb35f'} Jul 13 21:11:35.498879 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:11:35.498879 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:11:35.498879 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:11:35.498879 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:11:35.498879 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:11:35.498879 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:11:35.498879 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:11:35.498879 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:11:35.498879 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:11:35.498879 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:11:35.498879 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12316d28-2975-4c1e-b05b-82a3253bb35f could not be found. Jul 13 21:11:35.498879 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:11:35.498879 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:11:35.498879 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:11:35.498879 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:11:35.498879 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:11:35.498879 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:11:35.498879 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:11:35.498879 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:11:35.498879 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:11:35.500374 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:11:35.500374 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 21:11:35.500374 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 21:11:35.500374 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:11:35.500374 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:11:35.500374 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:11:35.500374 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:11:35.500374 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12316d28-2975-4c1e-b05b-82a3253bb35f could not be found. Jul 13 21:11:35.500374 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:11:35.500374 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:11:35.500374 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:11:35.500374 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:11:35.500374 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:11:35.500374 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:11:35.500374 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:11:35.500374 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:11:35.500374 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12316d28-2975-4c1e-b05b-82a3253bb35f could not be found. Jul 13 21:11:35.500374 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:11:35.501745 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0e3a7d99-0961-4406-a222-31d96783b277 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Returning 404 to user: Instance 12316d28-2975-4c1e-b05b-82a3253bb35f could not be found. {{(pid=118444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:11:35.501745 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-0e3a7d99-0961-4406-a222-31d96783b277 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 404 len: 111 microversion: 2.20 time: 0.029766 Jul 13 21:11:35.501745 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 416/843] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:11:35 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 13 21:11:35.506231 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-66bf8c8a-f35b-42b5-a930-12719ddb0cc3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '.version_select at 0x7f96e887e820>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:35.524673 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-66bf8c8a-f35b-42b5-a930-12719ddb0cc3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-71669427" status: 204 len: 0 microversion: 2.20 time: 0.022275 Jul 13 21:11:35.525226 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 428/844] 10.222.0.39 () {60 vars in 1255 bytes} [Wed Jul 13 21:11:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-71669427 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 13 21:11:36.158841 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-fb8e7db8-a832-47e8-80f2-44e64e25321d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Action: 'create', calling method: .version_select at 0x7f96e864e0d0>, body: {"keypair": {"name": "tempest-keypair-385341587", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmTLjVtCeC4zeLWMpngihoqQ0vQnuxMReduWp66aymg3dje0b/bGq14S1i4t8dzhAlQ9y/kYoI+grzz2O/qkVlF8D1gb42c45R++gcTds1GsydCIioyBuZItYWEuGSd5A=="}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:11:36.172150 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.quota [None req-fb8e7db8-a832-47e8-80f2-44e64e25321d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Getting quotas for project e43ca8a5c9f2494fbb9c5c5509c5c79b. Resources: {'key_pairs'} {{(pid=118444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:11:36.175856 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.quota [None req-fb8e7db8-a832-47e8-80f2-44e64e25321d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Getting quotas for user 0884a33a47e448e7826f257880a28964 and project e43ca8a5c9f2494fbb9c5c5509c5c79b. Resources: {'key_pairs'} {{(pid=118444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:11:36.197647 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-fb8e7db8-a832-47e8-80f2-44e64e25321d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.042756 Jul 13 21:11:36.198235 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 417/845] 10.222.0.39 () {62 vars in 1199 bytes} [Wed Jul 13 21:11:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 44 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 13 21:11:37.365100 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-761f4d6e-fc8f-4ee0-8cda-dc3227b2bb31 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1380758173", "imageRef": "5a995c88-d784-4a51-a6b9-25aa9dfe607c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e4e5de2-72e4-405c-8aa3-edc28c7af7f6"}], "security_groups": [{"name": "tempest-securitygroup--991528847"}], "key_name": "tempest-keypair-385341587", "user_data": "}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:11:37.468058 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.network.neutron [None req-761f4d6e-fc8f-4ee0-8cda-dc3227b2bb31 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] validate_networks() for [('4e4e5de2-72e4-405c-8aa3-edc28c7af7f6', None, None, None, None, None)] {{(pid=118445) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 21:11:37.877775 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-761f4d6e-fc8f-4ee0-8cda-dc3227b2bb31 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Flavor limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 21:11:37.878276 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-761f4d6e-fc8f-4ee0-8cda-dc3227b2bb31 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Image limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 21:11:37.878854 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-761f4d6e-fc8f-4ee0-8cda-dc3227b2bb31 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Flavor pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 21:11:37.879333 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-761f4d6e-fc8f-4ee0-8cda-dc3227b2bb31 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Image pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 21:11:37.879820 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-761f4d6e-fc8f-4ee0-8cda-dc3227b2bb31 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 21:11:37.894293 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-761f4d6e-fc8f-4ee0-8cda-dc3227b2bb31 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:37.894642 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-761f4d6e-fc8f-4ee0-8cda-dc3227b2bb31 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:37.895469 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-761f4d6e-fc8f-4ee0-8cda-dc3227b2bb31 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:37.895925 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-761f4d6e-fc8f-4ee0-8cda-dc3227b2bb31 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:37.913374 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-761f4d6e-fc8f-4ee0-8cda-dc3227b2bb31 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Getting quotas for project e43ca8a5c9f2494fbb9c5c5509c5c79b. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:11:37.917332 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-761f4d6e-fc8f-4ee0-8cda-dc3227b2bb31 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Getting quotas for user 0884a33a47e448e7826f257880a28964 and project e43ca8a5c9f2494fbb9c5c5509c5c79b. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:11:37.928175 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-761f4d6e-fc8f-4ee0-8cda-dc3227b2bb31 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Going to run 1 instances... {{(pid=118445) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 21:11:37.930465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-761f4d6e-fc8f-4ee0-8cda-dc3227b2bb31 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995c88-d784-4a51-a6b9-25aa9dfe607c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118445) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 21:11:37.974414 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-761f4d6e-fc8f-4ee0-8cda-dc3227b2bb31 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.614217 Jul 13 21:11:37.975158 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 429/846] 10.222.0.39 () {62 vars in 1187 bytes} [Wed Jul 13 21:11:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 13 21:11:37.985443 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-65e52138-59b5-4624-abe3-7b7039c2ebb2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:37.986046 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-65e52138-59b5-4624-abe3-7b7039c2ebb2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:38.044288 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-65e52138-59b5-4624-abe3-7b7039c2ebb2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:38.051291 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-65e52138-59b5-4624-abe3-7b7039c2ebb2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:38.052858 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-65e52138-59b5-4624-abe3-7b7039c2ebb2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:38.053973 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-65e52138-59b5-4624-abe3-7b7039c2ebb2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1281 microversion: 2.20 time: 0.072858 Jul 13 21:11:38.054522 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 418/847] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:11:37 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:11:39.072158 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ed7ece76-befb-44a4-ae5e-9555a0e2d2c2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:39.072922 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ed7ece76-befb-44a4-ae5e-9555a0e2d2c2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:39.079870 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ed7ece76-befb-44a4-ae5e-9555a0e2d2c2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:39.080323 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ed7ece76-befb-44a4-ae5e-9555a0e2d2c2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:39.081135 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ed7ece76-befb-44a4-ae5e-9555a0e2d2c2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:39.081562 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ed7ece76-befb-44a4-ae5e-9555a0e2d2c2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:39.160317 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ed7ece76-befb-44a4-ae5e-9555a0e2d2c2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:39.169117 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ed7ece76-befb-44a4-ae5e-9555a0e2d2c2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:39.170681 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ed7ece76-befb-44a4-ae5e-9555a0e2d2c2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:39.171798 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ed7ece76-befb-44a4-ae5e-9555a0e2d2c2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1351 microversion: 2.20 time: 0.103835 Jul 13 21:11:39.172355 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 430/848] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:11:39 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:11:40.189189 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-4b87a1d6-615b-4642-9e7b-4a8496ec287d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:40.189822 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-4b87a1d6-615b-4642-9e7b-4a8496ec287d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:40.196977 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4b87a1d6-615b-4642-9e7b-4a8496ec287d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:40.197435 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4b87a1d6-615b-4642-9e7b-4a8496ec287d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:40.198286 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4b87a1d6-615b-4642-9e7b-4a8496ec287d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:40.199437 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4b87a1d6-615b-4642-9e7b-4a8496ec287d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:40.219122 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:11:40.416194 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-4b87a1d6-615b-4642-9e7b-4a8496ec287d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:40.424158 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-4b87a1d6-615b-4642-9e7b-4a8496ec287d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:40.425647 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-4b87a1d6-615b-4642-9e7b-4a8496ec287d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:40.427175 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-4b87a1d6-615b-4642-9e7b-4a8496ec287d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1406 microversion: 2.20 time: 0.241914 Jul 13 21:11:40.427736 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 419/849] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:11:40 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:11:41.121560 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-f980ad53-9315-4c5b-94da-2c5709c56a38 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:11:41.122570 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-f980ad53-9315-4c5b-94da-2c5709c56a38 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:41.130794 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f980ad53-9315-4c5b-94da-2c5709c56a38 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:41.131285 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f980ad53-9315-4c5b-94da-2c5709c56a38 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:41.132060 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f980ad53-9315-4c5b-94da-2c5709c56a38 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:41.132494 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f980ad53-9315-4c5b-94da-2c5709c56a38 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:41.156183 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.objects.instance [None req-f980ad53-9315-4c5b-94da-2c5709c56a38 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lazy-loading 'flavor' on Instance uuid 84e5ee85-86cb-4ee9-9002-22ded6b91cdd {{(pid=118445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:11:41.171599 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-e2413b5f-7a54-4be4-966f-33e505a451d1 req-54595698-6940-4241-8d93-1dc9117490d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d49b390c-173a-4b3b-b9ac-dc1afce64811", "tag": "6f0e0bf0-9555-4b8f-aeaf-d1acda127705"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:11:41.190975 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-e2413b5f-7a54-4be4-966f-33e505a451d1 req-54595698-6940-4241-8d93-1dc9117490d2 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:41.191583 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-e2413b5f-7a54-4be4-966f-33e505a451d1 req-54595698-6940-4241-8d93-1dc9117490d2 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:41.207435 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-e2413b5f-7a54-4be4-966f-33e505a451d1 req-54595698-6940-4241-8d93-1dc9117490d2 service nova] Creating event network-changed:6f0e0bf0-9555-4b8f-aeaf-d1acda127705 for instance d49b390c-173a-4b3b-b9ac-dc1afce64811 on hv-cinder-79987 Jul 13 21:11:41.216301 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-e2413b5f-7a54-4be4-966f-33e505a451d1 req-54595698-6940-4241-8d93-1dc9117490d2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048582 Jul 13 21:11:41.217936 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 420/850] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:11:41.305508 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-f980ad53-9315-4c5b-94da-2c5709c56a38 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "POST /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd/action" status: 200 len: 32 microversion: 2.1 time: 0.187443 Jul 13 21:11:41.306125 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 431/851] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Jul 13 21:11:41 2022] POST /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd/action => generated 32 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 13 21:11:41.316559 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b92ec8e1-78f4-4b85-8a59-88ad4fc1c6b3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:41.317257 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b92ec8e1-78f4-4b85-8a59-88ad4fc1c6b3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:41.323962 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b92ec8e1-78f4-4b85-8a59-88ad4fc1c6b3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:41.324469 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b92ec8e1-78f4-4b85-8a59-88ad4fc1c6b3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:41.325384 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b92ec8e1-78f4-4b85-8a59-88ad4fc1c6b3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:41.325888 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b92ec8e1-78f4-4b85-8a59-88ad4fc1c6b3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:41.448870 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-178e0768-ad9c-4ee9-932a-6be3235dcf92 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:41.449549 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-178e0768-ad9c-4ee9-932a-6be3235dcf92 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:41.457256 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-178e0768-ad9c-4ee9-932a-6be3235dcf92 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:41.457714 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-178e0768-ad9c-4ee9-932a-6be3235dcf92 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:41.458534 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-178e0768-ad9c-4ee9-932a-6be3235dcf92 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:41.458980 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-178e0768-ad9c-4ee9-932a-6be3235dcf92 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:41.595662 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-178e0768-ad9c-4ee9-932a-6be3235dcf92 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:41.603696 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-178e0768-ad9c-4ee9-932a-6be3235dcf92 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:41.605182 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-178e0768-ad9c-4ee9-932a-6be3235dcf92 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:41.606281 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-178e0768-ad9c-4ee9-932a-6be3235dcf92 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1406 microversion: 2.20 time: 0.161756 Jul 13 21:11:41.606867 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 432/852] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:11:41 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:11:41.659467 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b92ec8e1-78f4-4b85-8a59-88ad4fc1c6b3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:41.667657 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b92ec8e1-78f4-4b85-8a59-88ad4fc1c6b3 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1737 microversion: 2.1 time: 0.355549 Jul 13 21:11:41.668381 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 421/853] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:41 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1737 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:42.623912 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-358628bc-2090-4357-b3bd-2ff60dc1130d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:42.624514 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-358628bc-2090-4357-b3bd-2ff60dc1130d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:42.630965 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-358628bc-2090-4357-b3bd-2ff60dc1130d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:42.631408 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-358628bc-2090-4357-b3bd-2ff60dc1130d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:42.632164 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-358628bc-2090-4357-b3bd-2ff60dc1130d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:42.632597 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-358628bc-2090-4357-b3bd-2ff60dc1130d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:42.684593 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-dbf346de-3086-40a5-8999-01097f3ee871 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:42.685198 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-dbf346de-3086-40a5-8999-01097f3ee871 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:42.691651 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-dbf346de-3086-40a5-8999-01097f3ee871 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:42.692101 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-dbf346de-3086-40a5-8999-01097f3ee871 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:42.692861 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-dbf346de-3086-40a5-8999-01097f3ee871 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:42.693309 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-dbf346de-3086-40a5-8999-01097f3ee871 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:42.759338 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-358628bc-2090-4357-b3bd-2ff60dc1130d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:42.767549 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-358628bc-2090-4357-b3bd-2ff60dc1130d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:42.769056 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-358628bc-2090-4357-b3bd-2ff60dc1130d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:42.770152 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-358628bc-2090-4357-b3bd-2ff60dc1130d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1406 microversion: 2.20 time: 0.150120 Jul 13 21:11:42.770802 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 433/854] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:11:42 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:11:42.824249 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-dbf346de-3086-40a5-8999-01097f3ee871 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:42.832123 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-dbf346de-3086-40a5-8999-01097f3ee871 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1737 microversion: 2.1 time: 0.151337 Jul 13 21:11:42.832682 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 422/855] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:42 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:11:43.788642 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c3e70a5f-ecb8-469b-b81e-25753d73ba29 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:43.789240 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-c3e70a5f-ecb8-469b-b81e-25753d73ba29 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:43.796045 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c3e70a5f-ecb8-469b-b81e-25753d73ba29 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:43.796482 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c3e70a5f-ecb8-469b-b81e-25753d73ba29 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:43.797227 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c3e70a5f-ecb8-469b-b81e-25753d73ba29 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:43.797654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c3e70a5f-ecb8-469b-b81e-25753d73ba29 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:43.849452 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-7b176886-cf72-43d7-9211-9615e0d25a32 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:43.850215 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-7b176886-cf72-43d7-9211-9615e0d25a32 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:43.856741 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7b176886-cf72-43d7-9211-9615e0d25a32 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:43.857186 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7b176886-cf72-43d7-9211-9615e0d25a32 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:43.857936 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7b176886-cf72-43d7-9211-9615e0d25a32 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:43.858368 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7b176886-cf72-43d7-9211-9615e0d25a32 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:43.926195 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c3e70a5f-ecb8-469b-b81e-25753d73ba29 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:43.934228 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c3e70a5f-ecb8-469b-b81e-25753d73ba29 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:43.935742 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c3e70a5f-ecb8-469b-b81e-25753d73ba29 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:43.936843 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-c3e70a5f-ecb8-469b-b81e-25753d73ba29 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1406 microversion: 2.20 time: 0.152098 Jul 13 21:11:43.937407 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 434/856] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:11:43 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:11:43.987041 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-7b176886-cf72-43d7-9211-9615e0d25a32 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:43.994868 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-7b176886-cf72-43d7-9211-9615e0d25a32 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1737 microversion: 2.1 time: 0.149175 Jul 13 21:11:43.995429 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 423/857] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:43 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:11:44.954755 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-bbf1c7cb-a5f6-4e37-bcb8-3161603c769f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:44.955365 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-bbf1c7cb-a5f6-4e37-bcb8-3161603c769f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:44.962287 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bbf1c7cb-a5f6-4e37-bcb8-3161603c769f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:44.962765 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bbf1c7cb-a5f6-4e37-bcb8-3161603c769f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:44.963530 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bbf1c7cb-a5f6-4e37-bcb8-3161603c769f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:44.963972 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bbf1c7cb-a5f6-4e37-bcb8-3161603c769f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:45.011900 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-61cf1f0f-0b9d-4001-b667-3265439e6c05 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:45.012754 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-61cf1f0f-0b9d-4001-b667-3265439e6c05 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:45.019347 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-61cf1f0f-0b9d-4001-b667-3265439e6c05 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:45.019792 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-61cf1f0f-0b9d-4001-b667-3265439e6c05 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:45.020550 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-61cf1f0f-0b9d-4001-b667-3265439e6c05 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:45.020983 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-61cf1f0f-0b9d-4001-b667-3265439e6c05 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:45.094011 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-bbf1c7cb-a5f6-4e37-bcb8-3161603c769f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:45.102539 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-bbf1c7cb-a5f6-4e37-bcb8-3161603c769f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:45.104057 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-bbf1c7cb-a5f6-4e37-bcb8-3161603c769f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:45.105158 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-bbf1c7cb-a5f6-4e37-bcb8-3161603c769f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1406 microversion: 2.20 time: 0.154391 Jul 13 21:11:45.105718 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 435/858] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:11:44 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:11:45.173629 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-61cf1f0f-0b9d-4001-b667-3265439e6c05 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:45.181554 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-61cf1f0f-0b9d-4001-b667-3265439e6c05 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1737 microversion: 2.1 time: 0.173447 Jul 13 21:11:45.182126 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 424/859] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:45 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:11:45.835227 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-099dc9e1-545d-40a4-86d8-cbbf3c7809ba tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1091793762"}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:11:45.835756 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-099dc9e1-545d-40a4-86d8-cbbf3c7809ba tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:45.841688 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-099dc9e1-545d-40a4-86d8-cbbf3c7809ba tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:45.842132 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-099dc9e1-545d-40a4-86d8-cbbf3c7809ba tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:45.842911 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-099dc9e1-545d-40a4-86d8-cbbf3c7809ba tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:45.843347 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-099dc9e1-545d-40a4-86d8-cbbf3c7809ba tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:45.847355 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:11:45.966902 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.network.security_group_api [None req-099dc9e1-545d-40a4-86d8-cbbf3c7809ba tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Removing security group 1d7ffe4e-809b-4bbb-ba24-169fe14761c0 from port 0cafa13d-1a14-44df-9c31-93ee2dc5a8a0 Jul 13 21:11:46.123983 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-fbbade3c-593a-4b4b-940f-f126a2e71e1c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:46.124696 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-fbbade3c-593a-4b4b-940f-f126a2e71e1c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:46.131331 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fbbade3c-593a-4b4b-940f-f126a2e71e1c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:46.131783 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fbbade3c-593a-4b4b-940f-f126a2e71e1c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:46.132545 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fbbade3c-593a-4b4b-940f-f126a2e71e1c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:46.132982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fbbade3c-593a-4b4b-940f-f126a2e71e1c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:46.264087 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-fbbade3c-593a-4b4b-940f-f126a2e71e1c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:46.274016 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-fbbade3c-593a-4b4b-940f-f126a2e71e1c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:46.275708 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-fbbade3c-593a-4b4b-940f-f126a2e71e1c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:46.277083 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-fbbade3c-593a-4b4b-940f-f126a2e71e1c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1406 microversion: 2.20 time: 0.157048 Jul 13 21:11:46.277739 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 425/860] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:11:46 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:11:46.282167 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-765987b8-b4c6-403d-aa4a-c53902fe9eec tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:46.282868 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-765987b8-b4c6-403d-aa4a-c53902fe9eec tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:46.289401 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-765987b8-b4c6-403d-aa4a-c53902fe9eec tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:46.289844 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-765987b8-b4c6-403d-aa4a-c53902fe9eec tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:46.290778 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-765987b8-b4c6-403d-aa4a-c53902fe9eec tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:46.291194 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-765987b8-b4c6-403d-aa4a-c53902fe9eec tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:46.340090 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-099dc9e1-545d-40a4-86d8-cbbf3c7809ba tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "POST /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786/action" status: 202 len: 0 microversion: 2.1 time: 0.508660 Jul 13 21:11:46.340693 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 436/861] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Jul 13 21:11:45 2022] POST /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 21:11:46.360013 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-6d2827e9-86b3-44b3-b8dc-8b880d5829ff req-338574b9-f3b7-4d3c-bb24-ff123ecaa6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b38afa70-d071-4833-bebb-86a20e1ee786", "tag": "0cafa13d-1a14-44df-9c31-93ee2dc5a8a0"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:11:46.369986 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-6d2827e9-86b3-44b3-b8dc-8b880d5829ff req-338574b9-f3b7-4d3c-bb24-ff123ecaa6b0 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:46.370665 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-6d2827e9-86b3-44b3-b8dc-8b880d5829ff req-338574b9-f3b7-4d3c-bb24-ff123ecaa6b0 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:46.390906 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-6d2827e9-86b3-44b3-b8dc-8b880d5829ff req-338574b9-f3b7-4d3c-bb24-ff123ecaa6b0 service nova] Creating event network-changed:0cafa13d-1a14-44df-9c31-93ee2dc5a8a0 for instance b38afa70-d071-4833-bebb-86a20e1ee786 on hv-cinder-79987 Jul 13 21:11:46.414110 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-6d2827e9-86b3-44b3-b8dc-8b880d5829ff req-338574b9-f3b7-4d3c-bb24-ff123ecaa6b0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057881 Jul 13 21:11:46.415051 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 437/862] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:11:46.529925 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-765987b8-b4c6-403d-aa4a-c53902fe9eec tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:46.538646 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-765987b8-b4c6-403d-aa4a-c53902fe9eec tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1737 microversion: 2.1 time: 0.259853 Jul 13 21:11:46.539227 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 426/863] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:46 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1737 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:47.296651 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-cbca4190-3221-43a9-a6a0-40cedba6f500 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:47.297337 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-cbca4190-3221-43a9-a6a0-40cedba6f500 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:47.303492 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-cbca4190-3221-43a9-a6a0-40cedba6f500 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:47.303946 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-cbca4190-3221-43a9-a6a0-40cedba6f500 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:47.304706 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-cbca4190-3221-43a9-a6a0-40cedba6f500 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:47.305133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-cbca4190-3221-43a9-a6a0-40cedba6f500 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:47.502924 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-cbca4190-3221-43a9-a6a0-40cedba6f500 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:47.511313 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-cbca4190-3221-43a9-a6a0-40cedba6f500 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:47.513087 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-cbca4190-3221-43a9-a6a0-40cedba6f500 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:47.514187 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-cbca4190-3221-43a9-a6a0-40cedba6f500 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1406 microversion: 2.20 time: 0.222233 Jul 13 21:11:47.514782 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 438/864] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:11:47 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:11:47.556081 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-86e51c0a-3a83-4575-9757-6edc0d0889d1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:47.556791 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-86e51c0a-3a83-4575-9757-6edc0d0889d1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:47.563195 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-86e51c0a-3a83-4575-9757-6edc0d0889d1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:47.563648 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-86e51c0a-3a83-4575-9757-6edc0d0889d1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:47.564402 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-86e51c0a-3a83-4575-9757-6edc0d0889d1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:47.564837 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-86e51c0a-3a83-4575-9757-6edc0d0889d1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:47.648909 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-7711ee92-50a4-4edc-8fab-8322590c4ca7 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:47.649528 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-7711ee92-50a4-4edc-8fab-8322590c4ca7 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:47.656009 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7711ee92-50a4-4edc-8fab-8322590c4ca7 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:47.656569 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7711ee92-50a4-4edc-8fab-8322590c4ca7 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:47.657440 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7711ee92-50a4-4edc-8fab-8322590c4ca7 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:47.657988 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7711ee92-50a4-4edc-8fab-8322590c4ca7 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:47.704702 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-86e51c0a-3a83-4575-9757-6edc0d0889d1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:47.712798 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-86e51c0a-3a83-4575-9757-6edc0d0889d1 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1737 microversion: 2.1 time: 0.160565 Jul 13 21:11:47.713456 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 427/865] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:47 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:11:47.748441 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.objects.instance [None req-7711ee92-50a4-4edc-8fab-8322590c4ca7 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lazy-loading 'services' on Instance uuid b38afa70-d071-4833-bebb-86a20e1ee786 {{(pid=118445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:11:47.821890 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-7711ee92-50a4-4edc-8fab-8322590c4ca7 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786/os-volume_attachments/ea16a74d-c6fa-4b2a-91ec-8de58b83d8a0" status: 202 len: 0 microversion: 2.1 time: 0.177471 Jul 13 21:11:47.822915 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 439/866] 10.222.0.39 () {58 vars in 1415 bytes} [Wed Jul 13 21:11:47 2022] DELETE /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786/os-volume_attachments/ea16a74d-c6fa-4b2a-91ec-8de58b83d8a0 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 21:11:47.830808 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-cda8f0d9-e598-47bb-aeb5-329db229803f tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:47.831809 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-cda8f0d9-e598-47bb-aeb5-329db229803f tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:47.838424 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-cda8f0d9-e598-47bb-aeb5-329db229803f tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:47.838916 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-cda8f0d9-e598-47bb-aeb5-329db229803f tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:47.839730 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-cda8f0d9-e598-47bb-aeb5-329db229803f tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:47.840122 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-cda8f0d9-e598-47bb-aeb5-329db229803f tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:47.873892 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-cda8f0d9-e598-47bb-aeb5-329db229803f tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046963 Jul 13 21:11:47.874862 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 428/867] 10.222.0.39 () {58 vars in 1301 bytes} [Wed Jul 13 21:11:47 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:11:48.425456 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=2 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:11:48.426949 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=6 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:11:48.431987 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-b25b94fb-7061-4c96-b276-c7e84999dd68 req-0d595271-e451-4439-be47-9e152eed70e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b38afa70-d071-4833-bebb-86a20e1ee786", "tag": "0cafa13d-1a14-44df-9c31-93ee2dc5a8a0"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:11:48.442333 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-b25b94fb-7061-4c96-b276-c7e84999dd68 req-0d595271-e451-4439-be47-9e152eed70e1 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:48.442822 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-b25b94fb-7061-4c96-b276-c7e84999dd68 req-0d595271-e451-4439-be47-9e152eed70e1 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:48.457316 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-b25b94fb-7061-4c96-b276-c7e84999dd68 req-0d595271-e451-4439-be47-9e152eed70e1 service nova] Creating event network-changed:0cafa13d-1a14-44df-9c31-93ee2dc5a8a0 for instance b38afa70-d071-4833-bebb-86a20e1ee786 on hv-cinder-79987 Jul 13 21:11:48.462803 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-b25b94fb-7061-4c96-b276-c7e84999dd68 req-0d595271-e451-4439-be47-9e152eed70e1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038032 Jul 13 21:11:48.463395 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 440/868] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:11:48.533231 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0bb5a3fa-04ad-40d0-b752-131e66b5c251 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:48.533832 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-0bb5a3fa-04ad-40d0-b752-131e66b5c251 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:48.535782 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell0:SELECT=6 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:11:48.541455 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0bb5a3fa-04ad-40d0-b752-131e66b5c251 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:48.541903 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0bb5a3fa-04ad-40d0-b752-131e66b5c251 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:48.542687 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0bb5a3fa-04ad-40d0-b752-131e66b5c251 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:48.543122 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0bb5a3fa-04ad-40d0-b752-131e66b5c251 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:48.731843 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-8b7be482-9bdc-4d9e-bfbb-55a671c5e145 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:48.732325 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8b7be482-9bdc-4d9e-bfbb-55a671c5e145 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:48.738694 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8b7be482-9bdc-4d9e-bfbb-55a671c5e145 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:48.739125 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8b7be482-9bdc-4d9e-bfbb-55a671c5e145 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:48.739886 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8b7be482-9bdc-4d9e-bfbb-55a671c5e145 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:48.740847 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8b7be482-9bdc-4d9e-bfbb-55a671c5e145 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:48.771789 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-0bb5a3fa-04ad-40d0-b752-131e66b5c251 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:48.781113 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-0bb5a3fa-04ad-40d0-b752-131e66b5c251 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:48.782758 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-0bb5a3fa-04ad-40d0-b752-131e66b5c251 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:48.783871 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-0bb5a3fa-04ad-40d0-b752-131e66b5c251 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1406 microversion: 2.20 time: 0.254624 Jul 13 21:11:48.784973 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 429/869] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:11:48 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:11:48.879162 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8b7be482-9bdc-4d9e-bfbb-55a671c5e145 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:48.885977 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-78662be8-9f9f-41e0-8883-a05a86da0fe5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:48.886922 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-78662be8-9f9f-41e0-8883-a05a86da0fe5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:48.888758 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-8b7be482-9bdc-4d9e-bfbb-55a671c5e145 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1737 microversion: 2.1 time: 0.161414 Jul 13 21:11:48.890648 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 441/870] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:48 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:48.894530 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-78662be8-9f9f-41e0-8883-a05a86da0fe5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:48.895014 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-78662be8-9f9f-41e0-8883-a05a86da0fe5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:48.898195 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-78662be8-9f9f-41e0-8883-a05a86da0fe5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:48.898671 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-78662be8-9f9f-41e0-8883-a05a86da0fe5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:48.926452 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-78662be8-9f9f-41e0-8883-a05a86da0fe5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044349 Jul 13 21:11:48.927037 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 430/871] 10.222.0.39 () {58 vars in 1301 bytes} [Wed Jul 13 21:11:48 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:11:49.497027 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-eec19c78-d668-4f1b-bd9d-449e843244f1 req-eb016d61-947a-4a50-be73-89acf8918ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49b390c-173a-4b3b-b9ac-dc1afce64811", "name": "network-vif-plugged", "status": "completed", "tag": "6f0e0bf0-9555-4b8f-aeaf-d1acda127705"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:11:49.505487 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-eec19c78-d668-4f1b-bd9d-449e843244f1 req-eb016d61-947a-4a50-be73-89acf8918ae1 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:49.506552 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-eec19c78-d668-4f1b-bd9d-449e843244f1 req-eb016d61-947a-4a50-be73-89acf8918ae1 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:49.518158 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-eec19c78-d668-4f1b-bd9d-449e843244f1 req-eb016d61-947a-4a50-be73-89acf8918ae1 service nova] Creating event network-vif-plugged:6f0e0bf0-9555-4b8f-aeaf-d1acda127705 for instance d49b390c-173a-4b3b-b9ac-dc1afce64811 on hv-cinder-79987 Jul 13 21:11:49.523616 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-eec19c78-d668-4f1b-bd9d-449e843244f1 req-eb016d61-947a-4a50-be73-89acf8918ae1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029856 Jul 13 21:11:49.524194 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 442/872] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:11:49.801541 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-5d2c7c49-4c8a-4ea6-bdd1-19e95e3bb3f1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:49.802139 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-5d2c7c49-4c8a-4ea6-bdd1-19e95e3bb3f1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:49.809153 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5d2c7c49-4c8a-4ea6-bdd1-19e95e3bb3f1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:49.809597 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5d2c7c49-4c8a-4ea6-bdd1-19e95e3bb3f1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:49.810773 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5d2c7c49-4c8a-4ea6-bdd1-19e95e3bb3f1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:49.811208 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5d2c7c49-4c8a-4ea6-bdd1-19e95e3bb3f1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:49.905655 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-72144976-d604-4888-8c8e-696f7f9b8b40 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:49.906480 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-72144976-d604-4888-8c8e-696f7f9b8b40 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:49.913253 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-72144976-d604-4888-8c8e-696f7f9b8b40 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:49.913786 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-72144976-d604-4888-8c8e-696f7f9b8b40 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:49.914651 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-72144976-d604-4888-8c8e-696f7f9b8b40 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:49.915140 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-72144976-d604-4888-8c8e-696f7f9b8b40 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:49.939953 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-5d2c7c49-4c8a-4ea6-bdd1-19e95e3bb3f1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:49.947924 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-5d2c7c49-4c8a-4ea6-bdd1-19e95e3bb3f1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:49.949409 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-5d2c7c49-4c8a-4ea6-bdd1-19e95e3bb3f1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:49.950501 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-5d2c7c49-4c8a-4ea6-bdd1-19e95e3bb3f1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1406 microversion: 2.20 time: 0.152842 Jul 13 21:11:49.951115 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 431/873] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:11:49 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:11:49.955551 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-a9c9c8e9-598c-4b9d-92f8-c8c46606cc05 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:49.956484 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-a9c9c8e9-598c-4b9d-92f8-c8c46606cc05 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:49.962246 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a9c9c8e9-598c-4b9d-92f8-c8c46606cc05 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:49.962719 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a9c9c8e9-598c-4b9d-92f8-c8c46606cc05 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:49.963472 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a9c9c8e9-598c-4b9d-92f8-c8c46606cc05 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:49.963900 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a9c9c8e9-598c-4b9d-92f8-c8c46606cc05 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:49.992900 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-a9c9c8e9-598c-4b9d-92f8-c8c46606cc05 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040768 Jul 13 21:11:49.993475 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 432/874] 10.222.0.39 () {58 vars in 1301 bytes} [Wed Jul 13 21:11:49 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 13 21:11:50.002601 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-40169d27-a9a2-4695-bdef-122d77ec85e5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:50.003106 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-40169d27-a9a2-4695-bdef-122d77ec85e5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:50.009168 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-40169d27-a9a2-4695-bdef-122d77ec85e5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:50.009619 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-40169d27-a9a2-4695-bdef-122d77ec85e5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:50.010390 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-40169d27-a9a2-4695-bdef-122d77ec85e5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:50.010859 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-40169d27-a9a2-4695-bdef-122d77ec85e5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:50.042933 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-72144976-d604-4888-8c8e-696f7f9b8b40 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:50.051077 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-72144976-d604-4888-8c8e-696f7f9b8b40 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1737 microversion: 2.1 time: 0.149589 Jul 13 21:11:50.051636 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 443/875] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:49 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:11:50.083544 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.wsgi [None req-40169d27-a9a2-4695-bdef-122d77ec85e5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] HTTP exception thrown: Instance b38afa70-d071-4833-bebb-86a20e1ee786 is not attached to volume ea16a74d-c6fa-4b2a-91ec-8de58b83d8a0 Jul 13 21:11:50.086022 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-40169d27-a9a2-4695-bdef-122d77ec85e5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Request method failure captured: Jul 13 21:11:50.086022 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: request: DELETE /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786/os-volume_attachments/ea16a74d-c6fa-4b2a-91ec-8de58b83d8a0 HTTP/1.1 Jul 13 21:11:50.086022 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept: application/json Jul 13 21:11:50.086022 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept-Encoding: identity Jul 13 21:11:50.086022 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Connection: close Jul 13 21:11:50.086022 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Length: 0 Jul 13 21:11:50.086022 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Type: application/json Jul 13 21:11:50.086022 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Host: 10.222.0.39 Jul 13 21:11:50.086022 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Openstack-System-Scope: None Jul 13 21:11:50.086022 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: User-Agent: python-urllib3/1.26.9 Jul 13 21:11:50.086022 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Auth-Token: gAAAAABizzPrH2RQgPxO0z5FHU1jdy9qcj7NrxlDibNvZqCIcZql2ayA9VZXobwHoLsi94Bl8CZ9zYUXzRYkRqv1zjG2z7ma0wjQq3s3_oz0t7cXW22tp8-OY1J_Oqt8TK9fO9nhClCH54UpgpqmeaUaWARmQr7fyTzZYm0VeUSTeiJyBbn37VU Jul 13 21:11:50.086022 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Id: None Jul 13 21:11:50.086022 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Name: None Jul 13 21:11:50.086022 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Identity-Status: Confirmed Jul 13 21:11:50.086022 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Is-Admin-Project: True Jul 13 21:11:50.086022 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Id: default Jul 13 21:11:50.086022 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Name: Default Jul 13 21:11:50.086022 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Id: c09f02b3463a47e68081b8b47cc86985 Jul 13 21:11:50.086022 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Name: tempest-TestMinimumBasicScenario-195141651 Jul 13 21:11:50.086022 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Role: member,reader Jul 13 21:11:50.086022 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Roles: member,reader Jul 13 21:11:50.087622 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c09f02b3463a47e68081b8b47cc86985"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c09f02b3463a47e68081b8b47cc86985"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c09f02b3463a47e68081b8b47cc86985", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c09f02b3463a47e68081b8b47cc86985"}]}] Jul 13 21:11:50.087622 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant: tempest-TestMinimumBasicScenario-195141651 Jul 13 21:11:50.087622 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Id: c09f02b3463a47e68081b8b47cc86985 Jul 13 21:11:50.087622 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Name: tempest-TestMinimumBasicScenario-195141651 Jul 13 21:11:50.087622 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User: tempest-TestMinimumBasicScenario-195141651-project Jul 13 21:11:50.087622 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Id: default Jul 13 21:11:50.087622 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Name: Default Jul 13 21:11:50.087622 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Id: 0c321d34fcce4054849926e924b3c0a8 Jul 13 21:11:50.087622 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Name: tempest-TestMinimumBasicScenario-195141651-project Jul 13 21:11:50.087622 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: method: > Jul 13 21:11:50.087622 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: exception: Instance b38afa70-d071-4833-bebb-86a20e1ee786 is not attached to volume ea16a74d-c6fa-4b2a-91ec-8de58b83d8a0 Jul 13 21:11:50.088441 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: action_args: {'server_id': 'b38afa70-d071-4833-bebb-86a20e1ee786', 'id': 'ea16a74d-c6fa-4b2a-91ec-8de58b83d8a0'} Jul 13 21:11:50.088441 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:11:50.088441 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:11:50.088441 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 13 21:11:50.088441 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 13 21:11:50.088441 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 13 21:11:50.088441 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 13 21:11:50.088441 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 13 21:11:50.088441 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 13 21:11:50.088441 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ea16a74d-c6fa-4b2a-91ec-8de58b83d8a0. Jul 13 21:11:50.088441 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:11:50.088441 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:11:50.088441 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:11:50.088441 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:11:50.088441 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:11:50.088441 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:11:50.088441 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:11:50.088441 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:11:50.088441 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:11:50.089792 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:11:50.089792 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 13 21:11:50.089792 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 13 21:11:50.089792 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b38afa70-d071-4833-bebb-86a20e1ee786 is not attached to volume ea16a74d-c6fa-4b2a-91ec-8de58b83d8a0 Jul 13 21:11:50.089792 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:11:50.089792 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:11:50.089792 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:11:50.089792 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:11:50.089792 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:11:50.089792 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:11:50.089792 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:11:50.089792 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:11:50.089792 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b38afa70-d071-4833-bebb-86a20e1ee786 is not attached to volume ea16a74d-c6fa-4b2a-91ec-8de58b83d8a0 Jul 13 21:11:50.089792 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:11:50.089792 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-40169d27-a9a2-4695-bdef-122d77ec85e5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Returning 404 to user: Instance b38afa70-d071-4833-bebb-86a20e1ee786 is not attached to volume ea16a74d-c6fa-4b2a-91ec-8de58b83d8a0 {{(pid=118444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:11:50.090861 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-40169d27-a9a2-4695-bdef-122d77ec85e5 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786/os-volume_attachments/ea16a74d-c6fa-4b2a-91ec-8de58b83d8a0" status: 404 len: 154 microversion: 2.1 time: 0.088504 Jul 13 21:11:50.090861 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 433/876] 10.222.0.39 () {58 vars in 1415 bytes} [Wed Jul 13 21:11:49 2022] DELETE /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786/os-volume_attachments/ea16a74d-c6fa-4b2a-91ec-8de58b83d8a0 => generated 154 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 13 21:11:50.968711 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c1cacae0-44e4-463b-826a-1c160f975bad tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:50.969315 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-c1cacae0-44e4-463b-826a-1c160f975bad tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:50.976123 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c1cacae0-44e4-463b-826a-1c160f975bad tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:50.976565 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c1cacae0-44e4-463b-826a-1c160f975bad tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:50.977323 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c1cacae0-44e4-463b-826a-1c160f975bad tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:50.977748 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c1cacae0-44e4-463b-826a-1c160f975bad tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:51.068494 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-d5260895-58a3-4eaa-8b36-8996d7c89508 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:51.069095 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-d5260895-58a3-4eaa-8b36-8996d7c89508 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:51.076393 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d5260895-58a3-4eaa-8b36-8996d7c89508 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:51.076841 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d5260895-58a3-4eaa-8b36-8996d7c89508 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:51.077595 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d5260895-58a3-4eaa-8b36-8996d7c89508 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:51.078034 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d5260895-58a3-4eaa-8b36-8996d7c89508 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:51.112944 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c1cacae0-44e4-463b-826a-1c160f975bad tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:51.123126 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c1cacae0-44e4-463b-826a-1c160f975bad tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:51.124608 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c1cacae0-44e4-463b-826a-1c160f975bad tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:51.125710 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-c1cacae0-44e4-463b-826a-1c160f975bad tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1406 microversion: 2.20 time: 0.160988 Jul 13 21:11:51.126267 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 444/877] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:11:50 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:11:51.205764 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-d5260895-58a3-4eaa-8b36-8996d7c89508 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:51.213864 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-d5260895-58a3-4eaa-8b36-8996d7c89508 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1737 microversion: 2.1 time: 0.149120 Jul 13 21:11:51.214546 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 434/878] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:51 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:11:51.219790 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-0309d51a-9d98-41ce-969a-98b274f92759 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:51.220215 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-0309d51a-9d98-41ce-969a-98b274f92759 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:51.227000 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0309d51a-9d98-41ce-969a-98b274f92759 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:51.227439 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0309d51a-9d98-41ce-969a-98b274f92759 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:51.228186 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0309d51a-9d98-41ce-969a-98b274f92759 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:51.228610 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0309d51a-9d98-41ce-969a-98b274f92759 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:51.252244 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-0309d51a-9d98-41ce-969a-98b274f92759 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Going to try to terminate instance {{(pid=118445) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 21:11:51.327509 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-0309d51a-9d98-41ce-969a-98b274f92759 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 204 len: 0 microversion: 2.1 time: 0.111361 Jul 13 21:11:51.328139 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 445/879] 10.222.0.39 () {58 vars in 1238 bytes} [Wed Jul 13 21:11:51 2022] DELETE /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 21:11:51.336649 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-09964bf5-3d26-4d28-9995-4fe2c2669d89 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:51.337247 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-09964bf5-3d26-4d28-9995-4fe2c2669d89 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:51.343152 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-09964bf5-3d26-4d28-9995-4fe2c2669d89 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:51.343595 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-09964bf5-3d26-4d28-9995-4fe2c2669d89 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:51.344339 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-09964bf5-3d26-4d28-9995-4fe2c2669d89 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:51.344768 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-09964bf5-3d26-4d28-9995-4fe2c2669d89 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:51.474143 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-09964bf5-3d26-4d28-9995-4fe2c2669d89 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:51.481491 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-09964bf5-3d26-4d28-9995-4fe2c2669d89 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1554 microversion: 2.1 time: 0.149217 Jul 13 21:11:51.482042 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 435/880] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:51 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:52.144703 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-5e5a0363-b63d-45f0-a793-aecdb831a632 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:52.145397 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-5e5a0363-b63d-45f0-a793-aecdb831a632 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:52.152135 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5e5a0363-b63d-45f0-a793-aecdb831a632 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:52.152570 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5e5a0363-b63d-45f0-a793-aecdb831a632 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:52.153321 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5e5a0363-b63d-45f0-a793-aecdb831a632 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:52.153744 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5e5a0363-b63d-45f0-a793-aecdb831a632 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:52.231512 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-839fa2db-a68e-4357-bcf8-f66103726095 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:52.232048 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-839fa2db-a68e-4357-bcf8-f66103726095 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:52.237995 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-839fa2db-a68e-4357-bcf8-f66103726095 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:52.238375 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-839fa2db-a68e-4357-bcf8-f66103726095 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:52.239156 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-839fa2db-a68e-4357-bcf8-f66103726095 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:52.239589 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-839fa2db-a68e-4357-bcf8-f66103726095 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:52.281861 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5e5a0363-b63d-45f0-a793-aecdb831a632 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:52.290771 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5e5a0363-b63d-45f0-a793-aecdb831a632 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:52.292314 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5e5a0363-b63d-45f0-a793-aecdb831a632 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:52.293456 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-5e5a0363-b63d-45f0-a793-aecdb831a632 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1597 microversion: 2.20 time: 0.153121 Jul 13 21:11:52.294008 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 446/881] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:11:52 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1597 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:11:52.311147 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-9068d093-b2df-4de9-b833-aa2df94c80e0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:52.311633 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-9068d093-b2df-4de9-b833-aa2df94c80e0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:52.317497 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9068d093-b2df-4de9-b833-aa2df94c80e0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:52.317944 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9068d093-b2df-4de9-b833-aa2df94c80e0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:52.318755 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9068d093-b2df-4de9-b833-aa2df94c80e0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:52.319200 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9068d093-b2df-4de9-b833-aa2df94c80e0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:52.371965 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-839fa2db-a68e-4357-bcf8-f66103726095 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:52.375443 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=100 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:11:52.380863 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-839fa2db-a68e-4357-bcf8-f66103726095 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1737 microversion: 2.1 time: 0.153360 Jul 13 21:11:52.381427 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 436/882] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:52 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:52.398827 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-9068d093-b2df-4de9-b833-aa2df94c80e0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091304 Jul 13 21:11:52.399448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 447/883] 10.222.0.39 () {60 vars in 1315 bytes} [Wed Jul 13 21:11:52 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 21:11:52.498752 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-cd2471a6-ab94-4b03-b168-e9e5c1e9f921 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:52.499292 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-cd2471a6-ab94-4b03-b168-e9e5c1e9f921 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:52.505724 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-cd2471a6-ab94-4b03-b168-e9e5c1e9f921 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:52.506172 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-cd2471a6-ab94-4b03-b168-e9e5c1e9f921 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:52.507003 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-cd2471a6-ab94-4b03-b168-e9e5c1e9f921 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:52.507442 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-cd2471a6-ab94-4b03-b168-e9e5c1e9f921 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:52.639143 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-cd2471a6-ab94-4b03-b168-e9e5c1e9f921 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:52.647066 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-cd2471a6-ab94-4b03-b168-e9e5c1e9f921 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1554 microversion: 2.1 time: 0.152128 Jul 13 21:11:52.648228 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 437/884] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:52 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:53.397705 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-1a9d18bd-f3fe-4a69-9ba2-8f8b37ed6d80 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:53.398305 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-1a9d18bd-f3fe-4a69-9ba2-8f8b37ed6d80 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:53.404654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1a9d18bd-f3fe-4a69-9ba2-8f8b37ed6d80 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:53.405096 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1a9d18bd-f3fe-4a69-9ba2-8f8b37ed6d80 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:53.405856 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1a9d18bd-f3fe-4a69-9ba2-8f8b37ed6d80 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:53.406280 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1a9d18bd-f3fe-4a69-9ba2-8f8b37ed6d80 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:53.572581 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-66daf095-896c-4f8e-a50b-aba05968ef40 req-dea2d03f-ca4b-4a3a-83d0-8dedb4effe2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d49b390c-173a-4b3b-b9ac-dc1afce64811", "tag": "6f0e0bf0-9555-4b8f-aeaf-d1acda127705"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:11:53.581298 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-66daf095-896c-4f8e-a50b-aba05968ef40 req-dea2d03f-ca4b-4a3a-83d0-8dedb4effe2d service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:53.581834 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-66daf095-896c-4f8e-a50b-aba05968ef40 req-dea2d03f-ca4b-4a3a-83d0-8dedb4effe2d service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:53.586538 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-1a9d18bd-f3fe-4a69-9ba2-8f8b37ed6d80 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:53.593154 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-66daf095-896c-4f8e-a50b-aba05968ef40 req-dea2d03f-ca4b-4a3a-83d0-8dedb4effe2d service nova] Creating event network-changed:6f0e0bf0-9555-4b8f-aeaf-d1acda127705 for instance d49b390c-173a-4b3b-b9ac-dc1afce64811 on hv-cinder-79987 Jul 13 21:11:53.594857 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-1a9d18bd-f3fe-4a69-9ba2-8f8b37ed6d80 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1737 microversion: 2.1 time: 0.201491 Jul 13 21:11:53.595731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 448/885] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:53 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1737 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:53.607287 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-66daf095-896c-4f8e-a50b-aba05968ef40 req-dea2d03f-ca4b-4a3a-83d0-8dedb4effe2d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038506 Jul 13 21:11:53.607884 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 438/886] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:11:53.664605 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-42a92c2e-92ef-4784-b51c-d8e2b1ef012e tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:53.665211 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-42a92c2e-92ef-4784-b51c-d8e2b1ef012e tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:53.671225 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-42a92c2e-92ef-4784-b51c-d8e2b1ef012e tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:53.671670 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-42a92c2e-92ef-4784-b51c-d8e2b1ef012e tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:53.672433 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-42a92c2e-92ef-4784-b51c-d8e2b1ef012e tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:53.672863 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-42a92c2e-92ef-4784-b51c-d8e2b1ef012e tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:53.806064 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-42a92c2e-92ef-4784-b51c-d8e2b1ef012e tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:53.814062 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-42a92c2e-92ef-4784-b51c-d8e2b1ef012e tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1554 microversion: 2.1 time: 0.153829 Jul 13 21:11:53.814649 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 449/887] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:53 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:11:54.717628 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-fd7d6cdf-c9ee-46e8-8093-b3739d9181d9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:54.718333 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-fd7d6cdf-c9ee-46e8-8093-b3739d9181d9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:54.724898 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fd7d6cdf-c9ee-46e8-8093-b3739d9181d9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:54.725348 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fd7d6cdf-c9ee-46e8-8093-b3739d9181d9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:54.726126 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fd7d6cdf-c9ee-46e8-8093-b3739d9181d9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:54.726561 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fd7d6cdf-c9ee-46e8-8093-b3739d9181d9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:54.831284 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-dcb115d5-679f-4f19-a203-92c9da0c4edd tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:54.831883 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-dcb115d5-679f-4f19-a203-92c9da0c4edd tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:54.838790 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-dcb115d5-679f-4f19-a203-92c9da0c4edd tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:54.839240 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-dcb115d5-679f-4f19-a203-92c9da0c4edd tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:54.840008 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-dcb115d5-679f-4f19-a203-92c9da0c4edd tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:54.840441 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-dcb115d5-679f-4f19-a203-92c9da0c4edd tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:54.967901 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-dcb115d5-679f-4f19-a203-92c9da0c4edd tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:54.976389 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-dcb115d5-679f-4f19-a203-92c9da0c4edd tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1554 microversion: 2.1 time: 0.148312 Jul 13 21:11:54.977057 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 450/888] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:54 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:11:55.056850 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-fd7d6cdf-c9ee-46e8-8093-b3739d9181d9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:55.066987 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-fd7d6cdf-c9ee-46e8-8093-b3739d9181d9 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1737 microversion: 2.1 time: 0.458607 Jul 13 21:11:55.068207 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 439/889] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:54 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1737 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:55.225257 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-b728362a-ac15-4190-b1e3-51ad155e7aa0 req-03c1bcd9-9de1-40bf-af34-0c4a06c418ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b38afa70-d071-4833-bebb-86a20e1ee786", "name": "network-vif-deleted", "tag": "0cafa13d-1a14-44df-9c31-93ee2dc5a8a0"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:11:55.233841 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-b728362a-ac15-4190-b1e3-51ad155e7aa0 req-03c1bcd9-9de1-40bf-af34-0c4a06c418ac service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:55.235092 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-b728362a-ac15-4190-b1e3-51ad155e7aa0 req-03c1bcd9-9de1-40bf-af34-0c4a06c418ac service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:55.249771 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-b728362a-ac15-4190-b1e3-51ad155e7aa0 req-03c1bcd9-9de1-40bf-af34-0c4a06c418ac service nova] Creating event network-vif-deleted:0cafa13d-1a14-44df-9c31-93ee2dc5a8a0 for instance b38afa70-d071-4833-bebb-86a20e1ee786 on hv-cinder-79987 Jul 13 21:11:55.255169 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-b728362a-ac15-4190-b1e3-51ad155e7aa0 req-03c1bcd9-9de1-40bf-af34-0c4a06c418ac service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033922 Jul 13 21:11:55.255775 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 451/890] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:11:55.993281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0fe413fa-9ca8-4158-90fc-d2569b99fc37 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:55.993946 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-0fe413fa-9ca8-4158-90fc-d2569b99fc37 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:56.000390 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0fe413fa-9ca8-4158-90fc-d2569b99fc37 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:56.000836 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0fe413fa-9ca8-4158-90fc-d2569b99fc37 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:56.001595 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0fe413fa-9ca8-4158-90fc-d2569b99fc37 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:56.002030 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0fe413fa-9ca8-4158-90fc-d2569b99fc37 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:56.032633 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0fe413fa-9ca8-4158-90fc-d2569b99fc37 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:56.033078 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0fe413fa-9ca8-4158-90fc-d2569b99fc37 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:56.033519 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.objects.instance [None req-0fe413fa-9ca8-4158-90fc-d2569b99fc37 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lazy-loading 'fault' on Instance uuid b38afa70-d071-4833-bebb-86a20e1ee786 {{(pid=118444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:11:56.076082 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-0fe413fa-9ca8-4158-90fc-d2569b99fc37 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:56.083648 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-0fe413fa-9ca8-4158-90fc-d2569b99fc37 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1348 microversion: 2.1 time: 0.094286 Jul 13 21:11:56.084243 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 440/891] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:55 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1348 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:56.086333 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-2787f59f-3ed3-4dfe-9d49-82894408bcbb tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:56.087185 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-2787f59f-3ed3-4dfe-9d49-82894408bcbb tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:56.093742 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2787f59f-3ed3-4dfe-9d49-82894408bcbb tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:56.094180 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2787f59f-3ed3-4dfe-9d49-82894408bcbb tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:56.094953 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2787f59f-3ed3-4dfe-9d49-82894408bcbb tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:56.095385 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2787f59f-3ed3-4dfe-9d49-82894408bcbb tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:56.223743 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-2787f59f-3ed3-4dfe-9d49-82894408bcbb tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:56.231659 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-2787f59f-3ed3-4dfe-9d49-82894408bcbb tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1737 microversion: 2.1 time: 0.150186 Jul 13 21:11:56.232199 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 452/892] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:56 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:11:57.101566 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0caa9c67-cc3c-4105-8301-a718e4e7e0cf tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:57.102167 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-0caa9c67-cc3c-4105-8301-a718e4e7e0cf tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:57.108664 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0caa9c67-cc3c-4105-8301-a718e4e7e0cf tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:57.109109 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0caa9c67-cc3c-4105-8301-a718e4e7e0cf tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:57.109862 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0caa9c67-cc3c-4105-8301-a718e4e7e0cf tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:57.110296 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0caa9c67-cc3c-4105-8301-a718e4e7e0cf tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:57.140265 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0caa9c67-cc3c-4105-8301-a718e4e7e0cf tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:57.140707 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0caa9c67-cc3c-4105-8301-a718e4e7e0cf tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:57.141148 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.objects.instance [None req-0caa9c67-cc3c-4105-8301-a718e4e7e0cf tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lazy-loading 'fault' on Instance uuid b38afa70-d071-4833-bebb-86a20e1ee786 {{(pid=118444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:11:57.180654 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-0caa9c67-cc3c-4105-8301-a718e4e7e0cf tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c321d34fcce4054849926e924b3c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09f02b3463a47e68081b8b47cc86985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:57.187833 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-0caa9c67-cc3c-4105-8301-a718e4e7e0cf tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 200 len: 1348 microversion: 2.1 time: 0.090684 Jul 13 21:11:57.188425 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 441/893] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:57 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 1348 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:57.248696 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-17cc33f2-310a-41e6-a466-97b239c376a7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:57.249892 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-17cc33f2-310a-41e6-a466-97b239c376a7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:57.252325 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:11:57.258080 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-17cc33f2-310a-41e6-a466-97b239c376a7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:57.258598 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-17cc33f2-310a-41e6-a466-97b239c376a7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:57.259387 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-17cc33f2-310a-41e6-a466-97b239c376a7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:57.259908 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-17cc33f2-310a-41e6-a466-97b239c376a7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:57.406857 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-17cc33f2-310a-41e6-a466-97b239c376a7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:57.410240 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:11:57.415634 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-17cc33f2-310a-41e6-a466-97b239c376a7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1737 microversion: 2.1 time: 0.170878 Jul 13 21:11:57.416213 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 453/894] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:57 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:58.205080 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-9fda3f4d-23ff-4945-a63c-44b99d24c45d tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:58.205687 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-9fda3f4d-23ff-4945-a63c-44b99d24c45d tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] [instance: b38afa70-d071-4833-bebb-86a20e1ee786] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:58.208110 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:11:58.214181 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9fda3f4d-23ff-4945-a63c-44b99d24c45d tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:58.214654 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9fda3f4d-23ff-4945-a63c-44b99d24c45d tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:58.215411 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9fda3f4d-23ff-4945-a63c-44b99d24c45d tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:58.215845 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9fda3f4d-23ff-4945-a63c-44b99d24c45d tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:58.229781 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.wsgi [None req-9fda3f4d-23ff-4945-a63c-44b99d24c45d tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] HTTP exception thrown: Instance b38afa70-d071-4833-bebb-86a20e1ee786 could not be found. Jul 13 21:11:58.231395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-9fda3f4d-23ff-4945-a63c-44b99d24c45d tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Request method failure captured: Jul 13 21:11:58.231395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: request: GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 HTTP/1.1 Jul 13 21:11:58.231395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept: application/json Jul 13 21:11:58.231395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept-Encoding: identity Jul 13 21:11:58.231395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Connection: close Jul 13 21:11:58.231395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Length: 0 Jul 13 21:11:58.231395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Type: application/json Jul 13 21:11:58.231395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Host: 10.222.0.39 Jul 13 21:11:58.231395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Openstack-System-Scope: None Jul 13 21:11:58.231395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: User-Agent: python-urllib3/1.26.9 Jul 13 21:11:58.231395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Auth-Token: gAAAAABizzPrH2RQgPxO0z5FHU1jdy9qcj7NrxlDibNvZqCIcZql2ayA9VZXobwHoLsi94Bl8CZ9zYUXzRYkRqv1zjG2z7ma0wjQq3s3_oz0t7cXW22tp8-OY1J_Oqt8TK9fO9nhClCH54UpgpqmeaUaWARmQr7fyTzZYm0VeUSTeiJyBbn37VU Jul 13 21:11:58.231395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Id: None Jul 13 21:11:58.231395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Name: None Jul 13 21:11:58.231395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Identity-Status: Confirmed Jul 13 21:11:58.231395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Is-Admin-Project: True Jul 13 21:11:58.231395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Id: default Jul 13 21:11:58.231395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Name: Default Jul 13 21:11:58.231395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Id: c09f02b3463a47e68081b8b47cc86985 Jul 13 21:11:58.231395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Name: tempest-TestMinimumBasicScenario-195141651 Jul 13 21:11:58.231395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Role: member,reader Jul 13 21:11:58.231395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Roles: member,reader Jul 13 21:11:58.233024 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c09f02b3463a47e68081b8b47cc86985"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c09f02b3463a47e68081b8b47cc86985"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c09f02b3463a47e68081b8b47cc86985", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c09f02b3463a47e68081b8b47cc86985"}]}] Jul 13 21:11:58.233024 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant: tempest-TestMinimumBasicScenario-195141651 Jul 13 21:11:58.233024 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Id: c09f02b3463a47e68081b8b47cc86985 Jul 13 21:11:58.233024 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Name: tempest-TestMinimumBasicScenario-195141651 Jul 13 21:11:58.233024 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User: tempest-TestMinimumBasicScenario-195141651-project Jul 13 21:11:58.233024 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Id: default Jul 13 21:11:58.233024 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Name: Default Jul 13 21:11:58.233024 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Id: 0c321d34fcce4054849926e924b3c0a8 Jul 13 21:11:58.233024 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Name: tempest-TestMinimumBasicScenario-195141651-project Jul 13 21:11:58.233024 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: method: > Jul 13 21:11:58.233024 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: exception: Instance b38afa70-d071-4833-bebb-86a20e1ee786 could not be found. Jul 13 21:11:58.233024 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: action_args: {'id': 'b38afa70-d071-4833-bebb-86a20e1ee786'} Jul 13 21:11:58.233901 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:11:58.233901 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:11:58.233901 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:11:58.233901 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:11:58.233901 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:11:58.233901 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:11:58.233901 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:11:58.233901 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:11:58.233901 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:11:58.233901 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:11:58.233901 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b38afa70-d071-4833-bebb-86a20e1ee786 could not be found. Jul 13 21:11:58.233901 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:11:58.233901 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:11:58.233901 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:11:58.233901 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:11:58.233901 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:11:58.233901 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:11:58.233901 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:11:58.233901 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:11:58.233901 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:11:58.235477 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:11:58.235477 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 21:11:58.235477 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 21:11:58.235477 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:11:58.235477 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:11:58.235477 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:11:58.235477 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:11:58.235477 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b38afa70-d071-4833-bebb-86a20e1ee786 could not be found. Jul 13 21:11:58.235477 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:11:58.235477 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:11:58.235477 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:11:58.235477 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:11:58.235477 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:11:58.235477 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:11:58.235477 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:11:58.235477 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:11:58.235477 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b38afa70-d071-4833-bebb-86a20e1ee786 could not be found. Jul 13 21:11:58.235477 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:11:58.236771 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-9fda3f4d-23ff-4945-a63c-44b99d24c45d tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Returning 404 to user: Instance b38afa70-d071-4833-bebb-86a20e1ee786 could not be found. {{(pid=118444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:11:58.236771 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-9fda3f4d-23ff-4945-a63c-44b99d24c45d tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786" status: 404 len: 111 microversion: 2.1 time: 0.031544 Jul 13 21:11:58.236771 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 442/895] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:58 2022] GET /compute/v2.1/servers/b38afa70-d071-4833-bebb-86a20e1ee786 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:11:58.242998 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-0979f53b-ac97-49e1-a949-e133eafc8f63 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] Calling method '.version_select at 0x7f96e8736d30>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:58.259838 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-0979f53b-ac97-49e1-a949-e133eafc8f63 tempest-TestMinimumBasicScenario-195141651 tempest-TestMinimumBasicScenario-195141651-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-239570111" status: 202 len: 0 microversion: 2.1 time: 0.021867 Jul 13 21:11:58.260541 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 454/896] 10.222.0.39 () {58 vars in 1268 bytes} [Wed Jul 13 21:11:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-239570111 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 21:11:58.432735 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-cbd52dde-7a6c-49e5-91c3-237d3dece3ba tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:58.433276 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-cbd52dde-7a6c-49e5-91c3-237d3dece3ba tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:58.439283 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-cbd52dde-7a6c-49e5-91c3-237d3dece3ba tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:58.439935 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-cbd52dde-7a6c-49e5-91c3-237d3dece3ba tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:58.440699 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-cbd52dde-7a6c-49e5-91c3-237d3dece3ba tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:58.441141 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-cbd52dde-7a6c-49e5-91c3-237d3dece3ba tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:58.733366 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-cbd52dde-7a6c-49e5-91c3-237d3dece3ba tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:58.741754 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-cbd52dde-7a6c-49e5-91c3-237d3dece3ba tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1737 microversion: 2.1 time: 0.312869 Jul 13 21:11:58.742406 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 443/897] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:58 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1737 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:11:59.759780 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-79608db9-0d80-40f9-b9cc-4dc64e5f8c6a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:11:59.760413 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-79608db9-0d80-40f9-b9cc-4dc64e5f8c6a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:11:59.767132 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-79608db9-0d80-40f9-b9cc-4dc64e5f8c6a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:59.767581 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-79608db9-0d80-40f9-b9cc-4dc64e5f8c6a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:59.768395 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-79608db9-0d80-40f9-b9cc-4dc64e5f8c6a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:11:59.768811 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-79608db9-0d80-40f9-b9cc-4dc64e5f8c6a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:11:59.974699 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-79608db9-0d80-40f9-b9cc-4dc64e5f8c6a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:11:59.983121 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-79608db9-0d80-40f9-b9cc-4dc64e5f8c6a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1717 microversion: 2.1 time: 0.227901 Jul 13 21:11:59.983693 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 455/898] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:11:59 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1717 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:12:00.039625 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ac0ead9b-a36e-4b3f-9ab9-955319e990c0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:12:00.040187 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-ac0ead9b-a36e-4b3f-9ab9-955319e990c0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:12:00.046955 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ac0ead9b-a36e-4b3f-9ab9-955319e990c0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:00.047409 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ac0ead9b-a36e-4b3f-9ab9-955319e990c0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:00.048173 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ac0ead9b-a36e-4b3f-9ab9-955319e990c0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:00.048607 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ac0ead9b-a36e-4b3f-9ab9-955319e990c0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:00.129733 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.wsgi [None req-ac0ead9b-a36e-4b3f-9ab9-955319e990c0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] HTTP exception thrown: Cannot 'detach_volume' instance 84e5ee85-86cb-4ee9-9002-22ded6b91cdd while it is in vm_state rescued Jul 13 21:12:00.131281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ac0ead9b-a36e-4b3f-9ab9-955319e990c0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Request method failure captured: Jul 13 21:12:00.131281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: request: DELETE /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd/os-volume_attachments/2298f029-a8b0-4a44-80eb-4ce54b0aac99 HTTP/1.1 Jul 13 21:12:00.131281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept: application/json Jul 13 21:12:00.131281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept-Encoding: identity Jul 13 21:12:00.131281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Connection: close Jul 13 21:12:00.131281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Length: 0 Jul 13 21:12:00.131281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Type: application/json Jul 13 21:12:00.131281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Host: 10.222.0.39 Jul 13 21:12:00.131281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Openstack-System-Scope: None Jul 13 21:12:00.131281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: User-Agent: python-urllib3/1.26.9 Jul 13 21:12:00.131281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Auth-Token: gAAAAABizzPtXHqQhWpxQh2KXbvi9Mgpby3iRjpl1OJ_e5HYVB22nvOaYbWB2MpVdcW6zYVpUTz-raJVgo1KpIKJjd8jQvSDDnfI08IVf2HZpBBPAsy36vIdZqbCwpfLiW8Y5tS--8G7qgwaLY75cvFnltcDSVPPHdqKdNVl_OBtO9Qz2UoyQNk Jul 13 21:12:00.131281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Id: None Jul 13 21:12:00.131281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Name: None Jul 13 21:12:00.131281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Identity-Status: Confirmed Jul 13 21:12:00.131281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Is-Admin-Project: True Jul 13 21:12:00.131281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Id: default Jul 13 21:12:00.131281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Name: Default Jul 13 21:12:00.131281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Id: c1d4119a1d0b474fb568818f1aaa933b Jul 13 21:12:00.131281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-156399502 Jul 13 21:12:00.131281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Role: member,reader Jul 13 21:12:00.131281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Roles: member,reader Jul 13 21:12:00.132897 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c1d4119a1d0b474fb568818f1aaa933b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c1d4119a1d0b474fb568818f1aaa933b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c1d4119a1d0b474fb568818f1aaa933b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c1d4119a1d0b474fb568818f1aaa933b"}]}] Jul 13 21:12:00.132897 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant: tempest-ServerRescueNegativeTestJSON-156399502 Jul 13 21:12:00.132897 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Id: c1d4119a1d0b474fb568818f1aaa933b Jul 13 21:12:00.132897 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-156399502 Jul 13 21:12:00.132897 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User: tempest-ServerRescueNegativeTestJSON-156399502-project Jul 13 21:12:00.132897 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Id: default Jul 13 21:12:00.132897 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Name: Default Jul 13 21:12:00.132897 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Id: dc40c07fceab4a83ba9324da868034aa Jul 13 21:12:00.132897 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Name: tempest-ServerRescueNegativeTestJSON-156399502-project Jul 13 21:12:00.132897 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: method: > Jul 13 21:12:00.132897 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: exception: Cannot 'detach_volume' instance 84e5ee85-86cb-4ee9-9002-22ded6b91cdd while it is in vm_state rescued Jul 13 21:12:00.133745 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: action_args: {'server_id': '84e5ee85-86cb-4ee9-9002-22ded6b91cdd', 'id': '2298f029-a8b0-4a44-80eb-4ce54b0aac99'} Jul 13 21:12:00.133745 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:12:00.133745 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:12:00.133745 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 13 21:12:00.133745 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 13 21:12:00.133745 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 13 21:12:00.133745 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 13 21:12:00.133745 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 13 21:12:00.133745 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 13 21:12:00.133745 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 84e5ee85-86cb-4ee9-9002-22ded6b91cdd in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 13 21:12:00.133745 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:12:00.133745 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:12:00.133745 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:12:00.133745 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:12:00.133745 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:12:00.133745 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:12:00.133745 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:12:00.133745 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:12:00.133745 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:12:00.133745 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:12:00.135315 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 13 21:12:00.135315 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 13 21:12:00.135315 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 13 21:12:00.135315 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 13 21:12:00.135315 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 84e5ee85-86cb-4ee9-9002-22ded6b91cdd while it is in vm_state rescued Jul 13 21:12:00.135315 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:12:00.135315 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:12:00.135315 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:12:00.135315 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:12:00.135315 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:12:00.135315 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:12:00.135315 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:12:00.135315 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:12:00.135315 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 84e5ee85-86cb-4ee9-9002-22ded6b91cdd while it is in vm_state rescued Jul 13 21:12:00.135315 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:12:00.135315 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ac0ead9b-a36e-4b3f-9ab9-955319e990c0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Returning 409 to user: Cannot 'detach_volume' instance 84e5ee85-86cb-4ee9-9002-22ded6b91cdd while it is in vm_state rescued {{(pid=118444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:12:00.136475 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ac0ead9b-a36e-4b3f-9ab9-955319e990c0 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "DELETE /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd/os-volume_attachments/2298f029-a8b0-4a44-80eb-4ce54b0aac99" status: 409 len: 152 microversion: 2.1 time: 0.097611 Jul 13 21:12:00.136475 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 444/899] 10.222.0.39 () {58 vars in 1415 bytes} [Wed Jul 13 21:12:00 2022] DELETE /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd/os-volume_attachments/2298f029-a8b0-4a44-80eb-4ce54b0aac99 => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 13 21:12:00.142220 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-56b065cc-7d3a-4068-83b1-7790ffede6c4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:12:00.142803 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-56b065cc-7d3a-4068-83b1-7790ffede6c4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:12:00.149436 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-56b065cc-7d3a-4068-83b1-7790ffede6c4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:00.149821 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-56b065cc-7d3a-4068-83b1-7790ffede6c4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:00.154851 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-56b065cc-7d3a-4068-83b1-7790ffede6c4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:00.155321 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-56b065cc-7d3a-4068-83b1-7790ffede6c4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:00.233100 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-56b065cc-7d3a-4068-83b1-7790ffede6c4 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "POST /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd/action" status: 202 len: 0 microversion: 2.1 time: 0.094954 Jul 13 21:12:00.234046 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 456/900] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Jul 13 21:12:00 2022] POST /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 21:12:00.241896 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-3b3c76fd-1939-48be-a691-20733532ffe6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:12:00.242511 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-3b3c76fd-1939-48be-a691-20733532ffe6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:12:00.248734 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3b3c76fd-1939-48be-a691-20733532ffe6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:00.249507 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3b3c76fd-1939-48be-a691-20733532ffe6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:00.250271 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3b3c76fd-1939-48be-a691-20733532ffe6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:00.250740 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3b3c76fd-1939-48be-a691-20733532ffe6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:00.492506 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-3b3c76fd-1939-48be-a691-20733532ffe6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:12:00.500643 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-3b3c76fd-1939-48be-a691-20733532ffe6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1725 microversion: 2.1 time: 0.262507 Jul 13 21:12:00.501457 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 445/901] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:12:00 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1725 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:12:01.519981 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-0b229bc5-f177-44a0-829f-393ca13fb35a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:12:01.520691 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-0b229bc5-f177-44a0-829f-393ca13fb35a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:12:01.527338 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0b229bc5-f177-44a0-829f-393ca13fb35a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:01.527774 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0b229bc5-f177-44a0-829f-393ca13fb35a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:01.528761 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0b229bc5-f177-44a0-829f-393ca13fb35a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:01.529376 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0b229bc5-f177-44a0-829f-393ca13fb35a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:01.739580 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-0b229bc5-f177-44a0-829f-393ca13fb35a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:12:01.747918 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-0b229bc5-f177-44a0-829f-393ca13fb35a tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1725 microversion: 2.1 time: 0.232770 Jul 13 21:12:01.748488 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 457/902] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:12:01 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1725 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:12:02.765993 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-754652ac-cc88-4502-9b14-7f9c0f52d257 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:12:02.766595 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-754652ac-cc88-4502-9b14-7f9c0f52d257 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:12:02.773276 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-754652ac-cc88-4502-9b14-7f9c0f52d257 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:02.773728 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-754652ac-cc88-4502-9b14-7f9c0f52d257 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:02.774497 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-754652ac-cc88-4502-9b14-7f9c0f52d257 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:02.774965 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-754652ac-cc88-4502-9b14-7f9c0f52d257 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:02.907038 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-754652ac-cc88-4502-9b14-7f9c0f52d257 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:12:02.915602 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-754652ac-cc88-4502-9b14-7f9c0f52d257 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1725 microversion: 2.1 time: 0.153710 Jul 13 21:12:02.916159 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 446/903] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:12:02 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:12:03.933324 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-bf157ae7-58b3-4a72-927b-9f4820e37c7c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:12:03.934240 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-bf157ae7-58b3-4a72-927b-9f4820e37c7c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:12:03.941327 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bf157ae7-58b3-4a72-927b-9f4820e37c7c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:03.941932 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bf157ae7-58b3-4a72-927b-9f4820e37c7c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:03.942891 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bf157ae7-58b3-4a72-927b-9f4820e37c7c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:03.943429 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bf157ae7-58b3-4a72-927b-9f4820e37c7c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:04.124665 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-bf157ae7-58b3-4a72-927b-9f4820e37c7c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:12:04.132839 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-bf157ae7-58b3-4a72-927b-9f4820e37c7c tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1725 microversion: 2.1 time: 0.203315 Jul 13 21:12:04.133399 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 458/904] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:12:03 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1725 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:12:05.149525 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-11d0261d-e898-42a1-8965-08a8cd455871 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:12:05.150137 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-11d0261d-e898-42a1-8965-08a8cd455871 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:12:05.164039 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-11d0261d-e898-42a1-8965-08a8cd455871 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:05.166104 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-11d0261d-e898-42a1-8965-08a8cd455871 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:05.166923 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-11d0261d-e898-42a1-8965-08a8cd455871 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:05.167368 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-11d0261d-e898-42a1-8965-08a8cd455871 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:05.317638 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-11d0261d-e898-42a1-8965-08a8cd455871 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:12:05.327335 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-11d0261d-e898-42a1-8965-08a8cd455871 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1731 microversion: 2.1 time: 0.181384 Jul 13 21:12:05.328125 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 447/905] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:12:05 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:12:05.344537 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-a7b39a3e-0da7-4d14-9e17-cf38c8b87a9d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:12:05.345153 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-a7b39a3e-0da7-4d14-9e17-cf38c8b87a9d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:12:05.352396 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a7b39a3e-0da7-4d14-9e17-cf38c8b87a9d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:05.352842 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a7b39a3e-0da7-4d14-9e17-cf38c8b87a9d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:05.353793 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a7b39a3e-0da7-4d14-9e17-cf38c8b87a9d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:05.354227 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a7b39a3e-0da7-4d14-9e17-cf38c8b87a9d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:05.524286 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-a7b39a3e-0da7-4d14-9e17-cf38c8b87a9d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.183945 Jul 13 21:12:05.525434 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 459/906] 10.222.0.39 () {58 vars in 1274 bytes} [Wed Jul 13 21:12:05 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd/os-interface => generated 285 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:12:06.457720 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-e8f654cb-8cf3-4a98-a465-7d9fdb8237f3 req-2e421d24-27f1-485a-ac7a-5aabf2063c24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84e5ee85-86cb-4ee9-9002-22ded6b91cdd", "tag": "b2e4f436-9a2c-40fa-b1c8-e749b75a70b9"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:12:06.471559 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-e8f654cb-8cf3-4a98-a465-7d9fdb8237f3 req-2e421d24-27f1-485a-ac7a-5aabf2063c24 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:06.471995 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-e8f654cb-8cf3-4a98-a465-7d9fdb8237f3 req-2e421d24-27f1-485a-ac7a-5aabf2063c24 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:06.483412 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-e8f654cb-8cf3-4a98-a465-7d9fdb8237f3 req-2e421d24-27f1-485a-ac7a-5aabf2063c24 service nova] Creating event network-changed:b2e4f436-9a2c-40fa-b1c8-e749b75a70b9 for instance 84e5ee85-86cb-4ee9-9002-22ded6b91cdd on hv-cinder-79987 Jul 13 21:12:06.489810 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-e8f654cb-8cf3-4a98-a465-7d9fdb8237f3 req-2e421d24-27f1-485a-ac7a-5aabf2063c24 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036554 Jul 13 21:12:06.491023 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 448/907] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:12:08.504322 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-3f3a9fd8-5bc0-4732-b5cc-3484e7eda7fe req-25073ece-3d94-4340-9602-883091f2160c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84e5ee85-86cb-4ee9-9002-22ded6b91cdd", "tag": "b2e4f436-9a2c-40fa-b1c8-e749b75a70b9"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:12:08.512589 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-3f3a9fd8-5bc0-4732-b5cc-3484e7eda7fe req-25073ece-3d94-4340-9602-883091f2160c service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:08.513032 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-3f3a9fd8-5bc0-4732-b5cc-3484e7eda7fe req-25073ece-3d94-4340-9602-883091f2160c service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:08.523790 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-3f3a9fd8-5bc0-4732-b5cc-3484e7eda7fe req-25073ece-3d94-4340-9602-883091f2160c service nova] Creating event network-changed:b2e4f436-9a2c-40fa-b1c8-e749b75a70b9 for instance 84e5ee85-86cb-4ee9-9002-22ded6b91cdd on hv-cinder-79987 Jul 13 21:12:08.528662 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-3f3a9fd8-5bc0-4732-b5cc-3484e7eda7fe req-25073ece-3d94-4340-9602-883091f2160c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028421 Jul 13 21:12:08.529165 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 460/908] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:12:24.841646 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_api:SELECT=13 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:12:24.842375 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=64 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:12:24.846375 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-c84396eb-e47f-41f0-b12f-546813505659 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:12:24.847393 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-c84396eb-e47f-41f0-b12f-546813505659 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:12:24.854882 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c84396eb-e47f-41f0-b12f-546813505659 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:24.855323 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c84396eb-e47f-41f0-b12f-546813505659 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:24.856098 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c84396eb-e47f-41f0-b12f-546813505659 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:24.856527 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c84396eb-e47f-41f0-b12f-546813505659 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:24.883609 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-c84396eb-e47f-41f0-b12f-546813505659 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043540 Jul 13 21:12:24.884148 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 449/909] 10.222.0.39 () {58 vars in 1301 bytes} [Wed Jul 13 21:12:24 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 13 21:12:24.938129 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:12:24.938902 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:12:24.942860 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c48c0d9e-443d-4e2f-bc8a-f33f6ab62546 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:12:24.943441 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-c48c0d9e-443d-4e2f-bc8a-f33f6ab62546 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:12:24.952552 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c48c0d9e-443d-4e2f-bc8a-f33f6ab62546 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:24.952995 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c48c0d9e-443d-4e2f-bc8a-f33f6ab62546 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:24.953754 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c48c0d9e-443d-4e2f-bc8a-f33f6ab62546 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:24.954185 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c48c0d9e-443d-4e2f-bc8a-f33f6ab62546 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:24.981714 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-c48c0d9e-443d-4e2f-bc8a-f33f6ab62546 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Going to try to terminate instance {{(pid=118445) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 21:12:25.053580 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-c48c0d9e-443d-4e2f-bc8a-f33f6ab62546 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "DELETE /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 204 len: 0 microversion: 2.1 time: 0.116599 Jul 13 21:12:25.054104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 461/910] 10.222.0.39 () {58 vars in 1238 bytes} [Wed Jul 13 21:12:24 2022] DELETE /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 21:12:25.062848 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-f2d935d2-7cfc-42fe-a6b3-04ebd3d5ed9e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:12:25.063444 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-f2d935d2-7cfc-42fe-a6b3-04ebd3d5ed9e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:12:25.069770 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f2d935d2-7cfc-42fe-a6b3-04ebd3d5ed9e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:25.070210 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f2d935d2-7cfc-42fe-a6b3-04ebd3d5ed9e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:25.071048 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f2d935d2-7cfc-42fe-a6b3-04ebd3d5ed9e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:25.071478 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f2d935d2-7cfc-42fe-a6b3-04ebd3d5ed9e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:25.204402 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f2d935d2-7cfc-42fe-a6b3-04ebd3d5ed9e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:12:25.212418 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-f2d935d2-7cfc-42fe-a6b3-04ebd3d5ed9e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1673 microversion: 2.1 time: 0.153397 Jul 13 21:12:25.212963 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 450/911] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:12:25 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:12:26.231654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-33868c07-0f4a-4a78-972c-23c9f0e12454 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:12:26.232259 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-33868c07-0f4a-4a78-972c-23c9f0e12454 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:12:26.238665 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-33868c07-0f4a-4a78-972c-23c9f0e12454 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:26.239112 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-33868c07-0f4a-4a78-972c-23c9f0e12454 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:26.239865 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-33868c07-0f4a-4a78-972c-23c9f0e12454 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:26.240295 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-33868c07-0f4a-4a78-972c-23c9f0e12454 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:26.369733 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-33868c07-0f4a-4a78-972c-23c9f0e12454 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:12:26.377157 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-33868c07-0f4a-4a78-972c-23c9f0e12454 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1673 microversion: 2.1 time: 0.149752 Jul 13 21:12:26.377715 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 462/912] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:12:26 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:12:27.394551 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-d8b2fb13-10fa-40bc-8178-10acda2d24d7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:12:27.395205 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-d8b2fb13-10fa-40bc-8178-10acda2d24d7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:12:27.401825 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d8b2fb13-10fa-40bc-8178-10acda2d24d7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:27.402285 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d8b2fb13-10fa-40bc-8178-10acda2d24d7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:27.403065 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d8b2fb13-10fa-40bc-8178-10acda2d24d7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:27.403501 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d8b2fb13-10fa-40bc-8178-10acda2d24d7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:27.470072 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-d8b2fb13-10fa-40bc-8178-10acda2d24d7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:12:27.477895 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-d8b2fb13-10fa-40bc-8178-10acda2d24d7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 200 len: 1606 microversion: 2.1 time: 0.087121 Jul 13 21:12:27.478401 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 451/913] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:12:27 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 1606 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:12:27.550143 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-ef3f2e0f-8991-4545-8532-ae26118cb5ce req-fd7ebe52-d35f-43d1-829f-4a240b41e8d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcbf4753-6006-45d1-af09-33b6f6047153", "name": "network-vif-deleted", "tag": "f4a4aa3a-af10-49d3-b754-e5211cb6004b"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:12:27.559523 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-ef3f2e0f-8991-4545-8532-ae26118cb5ce req-fd7ebe52-d35f-43d1-829f-4a240b41e8d6 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:27.560007 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-ef3f2e0f-8991-4545-8532-ae26118cb5ce req-fd7ebe52-d35f-43d1-829f-4a240b41e8d6 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:27.577018 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-ef3f2e0f-8991-4545-8532-ae26118cb5ce req-fd7ebe52-d35f-43d1-829f-4a240b41e8d6 service nova] Creating event network-vif-deleted:f4a4aa3a-af10-49d3-b754-e5211cb6004b for instance bcbf4753-6006-45d1-af09-33b6f6047153 on hv-cinder-79987 Jul 13 21:12:27.588071 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-ef3f2e0f-8991-4545-8532-ae26118cb5ce req-fd7ebe52-d35f-43d1-829f-4a240b41e8d6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042051 Jul 13 21:12:27.589126 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 463/914] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:12:28.494602 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-a1097d08-aea1-4b62-92fa-a7f8683dd84a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:12:28.495878 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-a1097d08-aea1-4b62-92fa-a7f8683dd84a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:12:28.501612 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a1097d08-aea1-4b62-92fa-a7f8683dd84a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:28.502062 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a1097d08-aea1-4b62-92fa-a7f8683dd84a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:28.502853 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a1097d08-aea1-4b62-92fa-a7f8683dd84a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:28.503290 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a1097d08-aea1-4b62-92fa-a7f8683dd84a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:28.516930 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.wsgi [None req-a1097d08-aea1-4b62-92fa-a7f8683dd84a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] HTTP exception thrown: Instance bcbf4753-6006-45d1-af09-33b6f6047153 could not be found. Jul 13 21:12:28.518575 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-a1097d08-aea1-4b62-92fa-a7f8683dd84a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Request method failure captured: Jul 13 21:12:28.518575 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: request: GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 HTTP/1.1 Jul 13 21:12:28.518575 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept: application/json Jul 13 21:12:28.518575 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept-Encoding: identity Jul 13 21:12:28.518575 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Connection: close Jul 13 21:12:28.518575 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Length: 0 Jul 13 21:12:28.518575 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Type: application/json Jul 13 21:12:28.518575 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Host: 10.222.0.39 Jul 13 21:12:28.518575 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Openstack-System-Scope: None Jul 13 21:12:28.518575 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: User-Agent: python-urllib3/1.26.9 Jul 13 21:12:28.518575 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Auth-Token: gAAAAABizzNnvTEZiOI9_WlVX5CVvpy3Mj2Fw5_JARaCLdXGG_S6rROVCIuEop7Bz-S9cxE-6ldc4jk9UXXteYr4spop1Oa2maIgRtkRboGZ9SaHekO4zqkoarKFomW_rivVAK5---K6IL4ITQLBj67A4zvHIZ_4zm2h5PrgbUsGISwn-mIDVrY Jul 13 21:12:28.518575 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Id: None Jul 13 21:12:28.518575 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Name: None Jul 13 21:12:28.518575 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Identity-Status: Confirmed Jul 13 21:12:28.518575 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Is-Admin-Project: True Jul 13 21:12:28.518575 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Id: default Jul 13 21:12:28.518575 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Name: Default Jul 13 21:12:28.518575 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Id: 91bc9f9f4bc04202aabc75fc4bb9a6b2 Jul 13 21:12:28.518575 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Name: tempest-AttachVolumeTestJSON-740956243 Jul 13 21:12:28.518575 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Role: member,reader Jul 13 21:12:28.518575 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Roles: member,reader Jul 13 21:12:28.520146 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91bc9f9f4bc04202aabc75fc4bb9a6b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/91bc9f9f4bc04202aabc75fc4bb9a6b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_91bc9f9f4bc04202aabc75fc4bb9a6b2", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91bc9f9f4bc04202aabc75fc4bb9a6b2"}]}] Jul 13 21:12:28.520146 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant: tempest-AttachVolumeTestJSON-740956243 Jul 13 21:12:28.520146 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Id: 91bc9f9f4bc04202aabc75fc4bb9a6b2 Jul 13 21:12:28.520146 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Name: tempest-AttachVolumeTestJSON-740956243 Jul 13 21:12:28.520146 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User: tempest-AttachVolumeTestJSON-740956243-project Jul 13 21:12:28.520146 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Id: default Jul 13 21:12:28.520146 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Name: Default Jul 13 21:12:28.520146 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Id: fc4afeb23348438eabfe22f1a975f9ab Jul 13 21:12:28.520146 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Name: tempest-AttachVolumeTestJSON-740956243-project Jul 13 21:12:28.520146 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: method: > Jul 13 21:12:28.520146 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: exception: Instance bcbf4753-6006-45d1-af09-33b6f6047153 could not be found. Jul 13 21:12:28.520146 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: action_args: {'id': 'bcbf4753-6006-45d1-af09-33b6f6047153'} Jul 13 21:12:28.521043 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:12:28.521043 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:12:28.521043 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:12:28.521043 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:12:28.521043 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:12:28.521043 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:12:28.521043 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:12:28.521043 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:12:28.521043 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:12:28.521043 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:12:28.521043 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcbf4753-6006-45d1-af09-33b6f6047153 could not be found. Jul 13 21:12:28.521043 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:12:28.521043 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:12:28.521043 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:12:28.521043 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:12:28.521043 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:12:28.521043 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:12:28.521043 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:12:28.521043 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:12:28.521043 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:12:28.523174 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:12:28.523174 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 21:12:28.523174 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 21:12:28.523174 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:12:28.523174 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:12:28.523174 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:12:28.523174 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:12:28.523174 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcbf4753-6006-45d1-af09-33b6f6047153 could not be found. Jul 13 21:12:28.523174 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:12:28.523174 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:12:28.523174 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:12:28.523174 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:12:28.523174 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:12:28.523174 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:12:28.523174 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:12:28.523174 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:12:28.523174 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcbf4753-6006-45d1-af09-33b6f6047153 could not be found. Jul 13 21:12:28.523174 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:12:28.524591 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-a1097d08-aea1-4b62-92fa-a7f8683dd84a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Returning 404 to user: Instance bcbf4753-6006-45d1-af09-33b6f6047153 could not be found. {{(pid=118444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:12:28.524591 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-a1097d08-aea1-4b62-92fa-a7f8683dd84a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 404 len: 111 microversion: 2.1 time: 0.029324 Jul 13 21:12:28.524591 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 452/915] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:12:28 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:12:28.530220 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-1bc060f0-3072-4625-9c41-a65b2936402b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '.version_select at 0x7f96e86b2040>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:12:28.547564 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-1bc060f0-3072-4625-9c41-a65b2936402b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-332840649" status: 202 len: 0 microversion: 2.1 time: 0.021628 Jul 13 21:12:28.548121 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 464/916] 10.222.0.39 () {58 vars in 1217 bytes} [Wed Jul 13 21:12:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-332840649 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 21:12:29.393202 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-e5645334-0986-4e95-97af-610735474306 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Action: 'create', calling method: .version_select at 0x7f96e863c700>, body: {"keypair": {"name": "tempest-keypair-709840540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/6lKGqyq+y2hpWUFczgCwnszP7yaCUEt38UaxlZbOGt9dNPPhbOET1rbP8KrtFtuV9qS7qyGMob0zxo043PHaddcMeRd1lAqS6U/mVGLeP4xKTkEpyibmYEvGzmNA7vg=="}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:12:29.407460 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.quota [None req-e5645334-0986-4e95-97af-610735474306 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Getting quotas for project 91bc9f9f4bc04202aabc75fc4bb9a6b2. Resources: {'key_pairs'} {{(pid=118444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:12:29.411124 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.quota [None req-e5645334-0986-4e95-97af-610735474306 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Getting quotas for user fc4afeb23348438eabfe22f1a975f9ab and project 91bc9f9f4bc04202aabc75fc4bb9a6b2. Resources: {'key_pairs'} {{(pid=118444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:12:29.433739 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-e5645334-0986-4e95-97af-610735474306 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044348 Jul 13 21:12:29.434306 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 453/917] 10.222.0.39 () {60 vars in 1158 bytes} [Wed Jul 13 21:12:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:12:30.683896 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-e6690bac-3d39-464d-8120-42c0a6b5b57d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2090440417", "imageRef": "5a995c88-d784-4a51-a6b9-25aa9dfe607c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1f6f7a2a-f189-4026-be44-d6e67e387919"}], "security_groups": [{"name": "tempest-securitygroup--484809224"}], "key_name": "tempest-keypair-709840540", "user_data": "}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:12:30.784460 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.network.neutron [None req-e6690bac-3d39-464d-8120-42c0a6b5b57d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] validate_networks() for [('1f6f7a2a-f189-4026-be44-d6e67e387919', None, None, None, None, None)] {{(pid=118445) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 21:12:31.158912 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-e6690bac-3d39-464d-8120-42c0a6b5b57d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Flavor limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 21:12:31.159330 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-e6690bac-3d39-464d-8120-42c0a6b5b57d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Image limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 21:12:31.159797 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-e6690bac-3d39-464d-8120-42c0a6b5b57d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Flavor pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 21:12:31.160198 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-e6690bac-3d39-464d-8120-42c0a6b5b57d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Image pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 21:12:31.160604 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-e6690bac-3d39-464d-8120-42c0a6b5b57d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 21:12:31.170112 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e6690bac-3d39-464d-8120-42c0a6b5b57d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:31.170584 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e6690bac-3d39-464d-8120-42c0a6b5b57d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:31.171398 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e6690bac-3d39-464d-8120-42c0a6b5b57d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:31.171823 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e6690bac-3d39-464d-8120-42c0a6b5b57d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:31.188573 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-e6690bac-3d39-464d-8120-42c0a6b5b57d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Getting quotas for project 91bc9f9f4bc04202aabc75fc4bb9a6b2. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:12:31.192431 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-e6690bac-3d39-464d-8120-42c0a6b5b57d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Getting quotas for user fc4afeb23348438eabfe22f1a975f9ab and project 91bc9f9f4bc04202aabc75fc4bb9a6b2. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:12:31.203391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-e6690bac-3d39-464d-8120-42c0a6b5b57d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Going to run 1 instances... {{(pid=118445) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 21:12:31.205679 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-e6690bac-3d39-464d-8120-42c0a6b5b57d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995c88-d784-4a51-a6b9-25aa9dfe607c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118445) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 21:12:31.252207 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-e6690bac-3d39-464d-8120-42c0a6b5b57d tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.572981 Jul 13 21:12:31.252857 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 465/918] 10.222.0.39 () {60 vars in 1146 bytes} [Wed Jul 13 21:12:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 21:12:31.263688 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0cda325d-cd7d-4f5b-be6a-efc3812ba1f7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:12:31.264299 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-0cda325d-cd7d-4f5b-be6a-efc3812ba1f7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:12:31.317239 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-0cda325d-cd7d-4f5b-be6a-efc3812ba1f7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:12:31.324235 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-0cda325d-cd7d-4f5b-be6a-efc3812ba1f7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147" status: 200 len: 1237 microversion: 2.1 time: 0.065330 Jul 13 21:12:31.324781 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 454/919] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:12:31 2022] GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147 => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:12:32.341187 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-95e60dfe-ceda-426b-8a8b-90a7aaf90e11 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:12:32.341902 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-95e60dfe-ceda-426b-8a8b-90a7aaf90e11 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:12:32.350010 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-95e60dfe-ceda-426b-8a8b-90a7aaf90e11 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:32.350458 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-95e60dfe-ceda-426b-8a8b-90a7aaf90e11 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:32.351825 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-95e60dfe-ceda-426b-8a8b-90a7aaf90e11 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:32.352268 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-95e60dfe-ceda-426b-8a8b-90a7aaf90e11 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:32.415877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-95e60dfe-ceda-426b-8a8b-90a7aaf90e11 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:12:32.423344 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-95e60dfe-ceda-426b-8a8b-90a7aaf90e11 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147" status: 200 len: 1295 microversion: 2.1 time: 0.086129 Jul 13 21:12:32.423890 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 466/920] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:12:32 2022] GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147 => generated 1295 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:12:33.441039 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-8199d1d6-1dee-4b3e-99ad-d8680093becd tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:12:33.441829 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-8199d1d6-1dee-4b3e-99ad-d8680093becd tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:12:33.448451 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8199d1d6-1dee-4b3e-99ad-d8680093becd tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:33.448970 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8199d1d6-1dee-4b3e-99ad-d8680093becd tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:33.449730 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8199d1d6-1dee-4b3e-99ad-d8680093becd tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:33.450162 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8199d1d6-1dee-4b3e-99ad-d8680093becd tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:33.645661 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-8199d1d6-1dee-4b3e-99ad-d8680093becd tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:12:33.653771 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-8199d1d6-1dee-4b3e-99ad-d8680093becd tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147" status: 200 len: 1362 microversion: 2.1 time: 0.216722 Jul 13 21:12:33.654289 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 455/921] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:12:33 2022] GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:12:33.772845 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-650d970e-6e50-4170-89fc-768321f4a730 req-68141587-457b-4fdb-b636-2177751a47ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a73f467-e517-4167-83fe-faad603cc147", "tag": "2ab1c1b6-5a22-428f-9915-264ae0e6ff92"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:12:33.783499 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-650d970e-6e50-4170-89fc-768321f4a730 req-68141587-457b-4fdb-b636-2177751a47ae service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:33.784282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-650d970e-6e50-4170-89fc-768321f4a730 req-68141587-457b-4fdb-b636-2177751a47ae service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:33.803891 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-650d970e-6e50-4170-89fc-768321f4a730 req-68141587-457b-4fdb-b636-2177751a47ae service nova] Creating event network-changed:2ab1c1b6-5a22-428f-9915-264ae0e6ff92 for instance 5a73f467-e517-4167-83fe-faad603cc147 on hv-cinder-79987 Jul 13 21:12:33.809053 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-650d970e-6e50-4170-89fc-768321f4a730 req-68141587-457b-4fdb-b636-2177751a47ae service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044628 Jul 13 21:12:33.809951 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 467/922] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:12:34.671279 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-2287be4b-5ce7-4ec1-9d58-4b9d6a9f40df tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:12:34.671889 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-2287be4b-5ce7-4ec1-9d58-4b9d6a9f40df tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:12:34.678313 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2287be4b-5ce7-4ec1-9d58-4b9d6a9f40df tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:34.678800 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2287be4b-5ce7-4ec1-9d58-4b9d6a9f40df tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:34.679567 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2287be4b-5ce7-4ec1-9d58-4b9d6a9f40df tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:34.680006 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2287be4b-5ce7-4ec1-9d58-4b9d6a9f40df tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:34.806869 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-2287be4b-5ce7-4ec1-9d58-4b9d6a9f40df tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:12:34.814210 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-2287be4b-5ce7-4ec1-9d58-4b9d6a9f40df tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147" status: 200 len: 1362 microversion: 2.1 time: 0.146795 Jul 13 21:12:34.814801 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 456/923] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:12:34 2022] GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:12:35.832479 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-f1a78fc6-adb5-48ed-93f2-2a7c4dc3ae30 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:12:35.833184 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-f1a78fc6-adb5-48ed-93f2-2a7c4dc3ae30 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:12:35.839923 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f1a78fc6-adb5-48ed-93f2-2a7c4dc3ae30 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:35.840368 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f1a78fc6-adb5-48ed-93f2-2a7c4dc3ae30 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:35.841123 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f1a78fc6-adb5-48ed-93f2-2a7c4dc3ae30 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:35.841556 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f1a78fc6-adb5-48ed-93f2-2a7c4dc3ae30 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:35.965147 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-f1a78fc6-adb5-48ed-93f2-2a7c4dc3ae30 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:12:35.972430 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-f1a78fc6-adb5-48ed-93f2-2a7c4dc3ae30 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147" status: 200 len: 1362 microversion: 2.1 time: 0.144678 Jul 13 21:12:35.972995 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 468/924] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:12:35 2022] GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:12:36.989653 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-76d62a9d-8941-4e32-8cf5-3f4824e7df17 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:12:36.990854 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-76d62a9d-8941-4e32-8cf5-3f4824e7df17 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:12:36.997425 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-76d62a9d-8941-4e32-8cf5-3f4824e7df17 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:36.997876 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-76d62a9d-8941-4e32-8cf5-3f4824e7df17 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:36.998648 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-76d62a9d-8941-4e32-8cf5-3f4824e7df17 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:36.999090 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-76d62a9d-8941-4e32-8cf5-3f4824e7df17 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:37.153353 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-76d62a9d-8941-4e32-8cf5-3f4824e7df17 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:12:37.160771 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-76d62a9d-8941-4e32-8cf5-3f4824e7df17 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147" status: 200 len: 1362 microversion: 2.1 time: 0.174935 Jul 13 21:12:37.161334 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 457/925] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:12:36 2022] GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:12:38.177263 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-f3a061e1-d1b2-407e-9675-7483c6b09b40 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:12:38.177874 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-f3a061e1-d1b2-407e-9675-7483c6b09b40 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:12:38.184305 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f3a061e1-d1b2-407e-9675-7483c6b09b40 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:38.184750 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f3a061e1-d1b2-407e-9675-7483c6b09b40 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:38.185505 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f3a061e1-d1b2-407e-9675-7483c6b09b40 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:38.185940 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f3a061e1-d1b2-407e-9675-7483c6b09b40 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:38.315283 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-f3a061e1-d1b2-407e-9675-7483c6b09b40 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:12:38.322593 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-f3a061e1-d1b2-407e-9675-7483c6b09b40 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147" status: 200 len: 1362 microversion: 2.1 time: 0.149209 Jul 13 21:12:38.323189 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 469/926] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:12:38 2022] GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:12:39.339301 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-a68f0517-6ac5-483b-a3c8-4ac6a42e3037 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:12:39.339900 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-a68f0517-6ac5-483b-a3c8-4ac6a42e3037 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:12:39.346312 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a68f0517-6ac5-483b-a3c8-4ac6a42e3037 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:39.346792 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a68f0517-6ac5-483b-a3c8-4ac6a42e3037 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:39.347544 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a68f0517-6ac5-483b-a3c8-4ac6a42e3037 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:39.347977 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a68f0517-6ac5-483b-a3c8-4ac6a42e3037 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:39.475084 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-a68f0517-6ac5-483b-a3c8-4ac6a42e3037 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:12:39.482289 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-a68f0517-6ac5-483b-a3c8-4ac6a42e3037 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147" status: 200 len: 1362 microversion: 2.1 time: 0.146797 Jul 13 21:12:39.482873 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 458/927] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:12:39 2022] GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:12:40.499333 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ae8fe6c0-ffaa-4b2a-90ca-c2175ff6dc86 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:12:40.499878 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ae8fe6c0-ffaa-4b2a-90ca-c2175ff6dc86 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:12:40.506868 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ae8fe6c0-ffaa-4b2a-90ca-c2175ff6dc86 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:40.507314 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ae8fe6c0-ffaa-4b2a-90ca-c2175ff6dc86 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:40.508070 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ae8fe6c0-ffaa-4b2a-90ca-c2175ff6dc86 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:40.508498 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ae8fe6c0-ffaa-4b2a-90ca-c2175ff6dc86 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:40.632381 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ae8fe6c0-ffaa-4b2a-90ca-c2175ff6dc86 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:12:40.639939 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ae8fe6c0-ffaa-4b2a-90ca-c2175ff6dc86 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147" status: 200 len: 1362 microversion: 2.1 time: 0.144551 Jul 13 21:12:40.640497 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 470/928] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:12:40 2022] GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:12:41.658274 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-7845d932-a2ba-4818-9475-f40a357fe6bc tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:12:41.658909 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-7845d932-a2ba-4818-9475-f40a357fe6bc tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:12:41.662126 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell0:SELECT=6 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:12:41.666921 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7845d932-a2ba-4818-9475-f40a357fe6bc tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:41.667388 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7845d932-a2ba-4818-9475-f40a357fe6bc tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:41.668159 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7845d932-a2ba-4818-9475-f40a357fe6bc tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:41.668591 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7845d932-a2ba-4818-9475-f40a357fe6bc tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:41.685377 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-0c7554ef-a5d5-4643-9d05-aed21fc521da req-21478d3c-4ac9-4c6c-a7d0-f8d0572a6cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a73f467-e517-4167-83fe-faad603cc147", "name": "network-vif-plugged", "status": "completed", "tag": "2ab1c1b6-5a22-428f-9915-264ae0e6ff92"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:12:41.691013 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=2 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:12:41.691902 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=6 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:12:41.697714 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-0c7554ef-a5d5-4643-9d05-aed21fc521da req-21478d3c-4ac9-4c6c-a7d0-f8d0572a6cf7 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:41.698820 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-0c7554ef-a5d5-4643-9d05-aed21fc521da req-21478d3c-4ac9-4c6c-a7d0-f8d0572a6cf7 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:41.711734 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-0c7554ef-a5d5-4643-9d05-aed21fc521da req-21478d3c-4ac9-4c6c-a7d0-f8d0572a6cf7 service nova] Creating event network-vif-plugged:2ab1c1b6-5a22-428f-9915-264ae0e6ff92 for instance 5a73f467-e517-4167-83fe-faad603cc147 on hv-cinder-79987 Jul 13 21:12:41.716657 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-0c7554ef-a5d5-4643-9d05-aed21fc521da req-21478d3c-4ac9-4c6c-a7d0-f8d0572a6cf7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034942 Jul 13 21:12:41.717454 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 471/929] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:12:41.806990 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-7845d932-a2ba-4818-9475-f40a357fe6bc tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:12:41.814426 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-7845d932-a2ba-4818-9475-f40a357fe6bc tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147" status: 200 len: 1362 microversion: 2.1 time: 0.160609 Jul 13 21:12:41.815001 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 459/930] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:12:41 2022] GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:12:42.833044 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-aa78a2e3-53b2-4cdf-8793-92d0abeee58e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:12:42.833647 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-aa78a2e3-53b2-4cdf-8793-92d0abeee58e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:12:42.840445 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-aa78a2e3-53b2-4cdf-8793-92d0abeee58e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:42.840890 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-aa78a2e3-53b2-4cdf-8793-92d0abeee58e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:42.841650 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-aa78a2e3-53b2-4cdf-8793-92d0abeee58e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:42.842149 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-aa78a2e3-53b2-4cdf-8793-92d0abeee58e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:42.971676 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-aa78a2e3-53b2-4cdf-8793-92d0abeee58e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:12:42.978993 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-aa78a2e3-53b2-4cdf-8793-92d0abeee58e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147" status: 200 len: 1362 microversion: 2.1 time: 0.150637 Jul 13 21:12:42.979553 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 472/931] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:12:42 2022] GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:12:43.996446 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-f73413f9-7aff-426e-acc5-dd1289d5544a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:12:43.997046 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-f73413f9-7aff-426e-acc5-dd1289d5544a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:12:44.003494 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f73413f9-7aff-426e-acc5-dd1289d5544a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:44.003937 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f73413f9-7aff-426e-acc5-dd1289d5544a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:44.004711 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f73413f9-7aff-426e-acc5-dd1289d5544a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:44.005144 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f73413f9-7aff-426e-acc5-dd1289d5544a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:44.137124 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f73413f9-7aff-426e-acc5-dd1289d5544a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:12:44.144757 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-f73413f9-7aff-426e-acc5-dd1289d5544a tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147" status: 200 len: 1362 microversion: 2.1 time: 0.152765 Jul 13 21:12:44.145352 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 460/932] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:12:43 2022] GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:12:45.161818 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-9c4f477b-2f70-48a2-9580-88a5fac8d27b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:12:45.162421 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-9c4f477b-2f70-48a2-9580-88a5fac8d27b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:12:45.169477 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9c4f477b-2f70-48a2-9580-88a5fac8d27b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:45.169918 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9c4f477b-2f70-48a2-9580-88a5fac8d27b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:45.170725 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9c4f477b-2f70-48a2-9580-88a5fac8d27b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:45.171161 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9c4f477b-2f70-48a2-9580-88a5fac8d27b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:45.296508 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-9c4f477b-2f70-48a2-9580-88a5fac8d27b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:12:45.303991 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-9c4f477b-2f70-48a2-9580-88a5fac8d27b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147" status: 200 len: 1549 microversion: 2.1 time: 0.146107 Jul 13 21:12:45.304552 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 473/933] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:12:45 2022] GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147 => generated 1549 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:12:45.320531 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-75b24790-909b-4e7e-925d-1c57e71461bf tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:12:45.321021 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-75b24790-909b-4e7e-925d-1c57e71461bf tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:12:45.327434 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-75b24790-909b-4e7e-925d-1c57e71461bf tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:45.327884 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-75b24790-909b-4e7e-925d-1c57e71461bf tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:45.328645 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-75b24790-909b-4e7e-925d-1c57e71461bf tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:45.329085 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-75b24790-909b-4e7e-925d-1c57e71461bf tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:45.404111 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-75b24790-909b-4e7e-925d-1c57e71461bf tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087812 Jul 13 21:12:45.404703 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 461/934] 10.222.0.39 () {58 vars in 1274 bytes} [Wed Jul 13 21:12:45 2022] GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:12:46.311348 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-dc2d01b7-8908-403c-bf98-36ce67d87b38 req-2ec1a9b1-6da9-4dff-8893-ee9214c143c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a73f467-e517-4167-83fe-faad603cc147", "tag": "2ab1c1b6-5a22-428f-9915-264ae0e6ff92"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:12:46.319781 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-dc2d01b7-8908-403c-bf98-36ce67d87b38 req-2ec1a9b1-6da9-4dff-8893-ee9214c143c9 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:46.320222 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-dc2d01b7-8908-403c-bf98-36ce67d87b38 req-2ec1a9b1-6da9-4dff-8893-ee9214c143c9 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:46.330935 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-dc2d01b7-8908-403c-bf98-36ce67d87b38 req-2ec1a9b1-6da9-4dff-8893-ee9214c143c9 service nova] Creating event network-changed:2ab1c1b6-5a22-428f-9915-264ae0e6ff92 for instance 5a73f467-e517-4167-83fe-faad603cc147 on hv-cinder-79987 Jul 13 21:12:46.336191 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-dc2d01b7-8908-403c-bf98-36ce67d87b38 req-2ec1a9b1-6da9-4dff-8893-ee9214c143c9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028428 Jul 13 21:12:46.336770 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 474/935] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:12:56.512426 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:12:56.513168 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=60 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:12:56.517478 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b73118bc-ac8d-4f0f-ba8c-ffc6b9c68bb2 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:12:56.517957 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b73118bc-ac8d-4f0f-ba8c-ffc6b9c68bb2 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:12:56.526322 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b73118bc-ac8d-4f0f-ba8c-ffc6b9c68bb2 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:56.526793 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b73118bc-ac8d-4f0f-ba8c-ffc6b9c68bb2 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:56.527596 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b73118bc-ac8d-4f0f-ba8c-ffc6b9c68bb2 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:56.527975 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b73118bc-ac8d-4f0f-ba8c-ffc6b9c68bb2 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:56.549967 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b73118bc-ac8d-4f0f-ba8c-ffc6b9c68bb2 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2/ips" status: 200 len: 148 microversion: 2.1 time: 0.039001 Jul 13 21:12:56.550517 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 462/936] 10.222.0.39 () {58 vars in 1247 bytes} [Wed Jul 13 21:12:56 2022] GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:12:57.853231 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:12:57.853973 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:12:57.858703 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-3613627e-ce5d-462f-bab3-b1b459a491d7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3df5de29-7ab6-46f4-add7-07f52f7e942f"}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:12:57.859857 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-3613627e-ce5d-462f-bab3-b1b459a491d7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:12:57.867474 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3613627e-ce5d-462f-bab3-b1b459a491d7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:57.867947 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3613627e-ce5d-462f-bab3-b1b459a491d7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:57.868721 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3613627e-ce5d-462f-bab3-b1b459a491d7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:12:57.869142 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3613627e-ce5d-462f-bab3-b1b459a491d7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:12:58.117735 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-3613627e-ce5d-462f-bab3-b1b459a491d7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "POST /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266360 Jul 13 21:12:58.118369 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 475/937] 10.222.0.39 () {60 vars in 1322 bytes} [Wed Jul 13 21:12:57 2022] POST /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:13:04.493630 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-7d9f7a91-3004-4606-ad77-8dde75a7e878 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:04.494189 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-7d9f7a91-3004-4606-ad77-8dde75a7e878 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:04.500525 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7d9f7a91-3004-4606-ad77-8dde75a7e878 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:04.501028 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7d9f7a91-3004-4606-ad77-8dde75a7e878 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:04.501954 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7d9f7a91-3004-4606-ad77-8dde75a7e878 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:04.502539 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7d9f7a91-3004-4606-ad77-8dde75a7e878 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:04.581615 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.objects.instance [None req-7d9f7a91-3004-4606-ad77-8dde75a7e878 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lazy-loading 'services' on Instance uuid 84e5ee85-86cb-4ee9-9002-22ded6b91cdd {{(pid=118444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:13:04.652303 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-7d9f7a91-3004-4606-ad77-8dde75a7e878 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "DELETE /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd/os-volume_attachments/2298f029-a8b0-4a44-80eb-4ce54b0aac99" status: 202 len: 0 microversion: 2.1 time: 0.162888 Jul 13 21:13:04.652879 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 463/938] 10.222.0.39 () {58 vars in 1415 bytes} [Wed Jul 13 21:13:04 2022] DELETE /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd/os-volume_attachments/2298f029-a8b0-4a44-80eb-4ce54b0aac99 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 21:13:04.662109 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ef638eb3-4f7e-4e63-9352-b637b4ce9276 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:04.663200 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ef638eb3-4f7e-4e63-9352-b637b4ce9276 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:04.673749 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ef638eb3-4f7e-4e63-9352-b637b4ce9276 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:04.674199 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ef638eb3-4f7e-4e63-9352-b637b4ce9276 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:04.674984 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ef638eb3-4f7e-4e63-9352-b637b4ce9276 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:04.675418 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ef638eb3-4f7e-4e63-9352-b637b4ce9276 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:04.706253 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ef638eb3-4f7e-4e63-9352-b637b4ce9276 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048847 Jul 13 21:13:04.707064 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 476/939] 10.222.0.39 () {58 vars in 1301 bytes} [Wed Jul 13 21:13:04 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:13:05.605224 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ea85b18b-ebc8-4989-a2d7-fc45e3c6368b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3df5de29-7ab6-46f4-add7-07f52f7e942f"}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:13:05.606458 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-ea85b18b-ebc8-4989-a2d7-fc45e3c6368b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:05.613012 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ea85b18b-ebc8-4989-a2d7-fc45e3c6368b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:05.613462 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ea85b18b-ebc8-4989-a2d7-fc45e3c6368b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:05.614232 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ea85b18b-ebc8-4989-a2d7-fc45e3c6368b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:05.614696 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ea85b18b-ebc8-4989-a2d7-fc45e3c6368b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:05.694381 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.wsgi [None req-ea85b18b-ebc8-4989-a2d7-fc45e3c6368b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] HTTP exception thrown: Invalid volume: volume 3df5de29-7ab6-46f4-add7-07f52f7e942f is already attached to instances: 823dc842-377a-4438-a1c5-73b5cce4cda2 Jul 13 21:13:05.696627 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ea85b18b-ebc8-4989-a2d7-fc45e3c6368b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Request method failure captured: Jul 13 21:13:05.696627 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: request: POST /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2/os-volume_attachments HTTP/1.1 Jul 13 21:13:05.696627 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept: application/json Jul 13 21:13:05.696627 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept-Encoding: identity Jul 13 21:13:05.696627 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Connection: close Jul 13 21:13:05.696627 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Length: 74 Jul 13 21:13:05.696627 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Type: application/json Jul 13 21:13:05.696627 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Host: 10.222.0.39 Jul 13 21:13:05.696627 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Openstack-System-Scope: None Jul 13 21:13:05.696627 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: User-Agent: python-urllib3/1.26.9 Jul 13 21:13:05.696627 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Auth-Token: gAAAAABizzNqbt1i7chwFPcQAba6b9dk7TD8_G2l_XT7jQopf9IFAZNKmztmBJ4IISK_ds_GpyDLtbYZUS7JtctAPU-Tk1Sa5a4_tbywXB6GjEvdott7LmC4oiwINlLKkOc-EI-NfdeC0sCeq7QrJd1h1pR8691UeSBeFVmfqq10_09s26cRblc Jul 13 21:13:05.696627 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Id: None Jul 13 21:13:05.696627 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Name: None Jul 13 21:13:05.696627 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Identity-Status: Confirmed Jul 13 21:13:05.696627 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Is-Admin-Project: True Jul 13 21:13:05.696627 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Id: default Jul 13 21:13:05.696627 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Name: Default Jul 13 21:13:05.696627 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Id: 0a2703a8b75043e0ab0656482fa9ddeb Jul 13 21:13:05.696627 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Name: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:13:05.696627 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Role: member,reader Jul 13 21:13:05.696627 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Roles: member,reader Jul 13 21:13:05.698312 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a2703a8b75043e0ab0656482fa9ddeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0a2703a8b75043e0ab0656482fa9ddeb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0a2703a8b75043e0ab0656482fa9ddeb", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a2703a8b75043e0ab0656482fa9ddeb"}]}] Jul 13 21:13:05.698312 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:13:05.698312 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Id: 0a2703a8b75043e0ab0656482fa9ddeb Jul 13 21:13:05.698312 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:13:05.698312 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User: tempest-AttachVolumeNegativeTest-334916766-project Jul 13 21:13:05.698312 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Id: default Jul 13 21:13:05.698312 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Name: Default Jul 13 21:13:05.698312 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Id: d9cab6f67cd34c46886d036ba170331e Jul 13 21:13:05.698312 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Name: tempest-AttachVolumeNegativeTest-334916766-project Jul 13 21:13:05.698312 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Jul 13 21:13:05.698312 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: {"volumeAttachment": {"volumeId": "3df5de29-7ab6-46f4-add7-07f52f7e942f"}} Jul 13 21:13:05.698312 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: method: > Jul 13 21:13:05.699237 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: exception: Invalid volume: volume 3df5de29-7ab6-46f4-add7-07f52f7e942f is already attached to instances: 823dc842-377a-4438-a1c5-73b5cce4cda2 Jul 13 21:13:05.699237 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: action_args: {'server_id': '823dc842-377a-4438-a1c5-73b5cce4cda2', 'body': {'volumeAttachment': {'volumeId': '3df5de29-7ab6-46f4-add7-07f52f7e942f'}}} Jul 13 21:13:05.699237 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:13:05.699237 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:05.699237 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 13 21:13:05.699237 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 13 21:13:05.699237 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 13 21:13:05.699237 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 13 21:13:05.699237 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 13 21:13:05.699237 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 13 21:13:05.699237 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 13 21:13:05.699237 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 13 21:13:05.699237 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 13 21:13:05.699237 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 13 21:13:05.699237 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3df5de29-7ab6-46f4-add7-07f52f7e942f is already attached to instances: 823dc842-377a-4438-a1c5-73b5cce4cda2 Jul 13 21:13:05.699237 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:13:05.699237 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:13:05.699237 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:13:05.699237 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:05.700699 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:13:05.700699 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:13:05.700699 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:13:05.700699 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:13:05.700699 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:13:05.700699 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:13:05.700699 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 13 21:13:05.700699 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 13 21:13:05.700699 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 13 21:13:05.700699 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 13 21:13:05.700699 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 13 21:13:05.700699 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 13 21:13:05.700699 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 13 21:13:05.700699 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 13 21:13:05.700699 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3df5de29-7ab6-46f4-add7-07f52f7e942f is already attached to instances: 823dc842-377a-4438-a1c5-73b5cce4cda2 Jul 13 21:13:05.700699 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:13:05.700699 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:13:05.700699 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:13:05.700699 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:05.700699 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:13:05.702184 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:13:05.702184 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:13:05.702184 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:13:05.702184 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3df5de29-7ab6-46f4-add7-07f52f7e942f is already attached to instances: 823dc842-377a-4438-a1c5-73b5cce4cda2 Jul 13 21:13:05.702184 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:13:05.702184 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ea85b18b-ebc8-4989-a2d7-fc45e3c6368b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Returning 400 to user: Invalid volume: volume 3df5de29-7ab6-46f4-add7-07f52f7e942f is already attached to instances: 823dc842-377a-4438-a1c5-73b5cce4cda2 {{(pid=118444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:13:05.702184 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ea85b18b-ebc8-4989-a2d7-fc45e3c6368b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "POST /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097783 Jul 13 21:13:05.702184 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 464/940] 10.222.0.39 () {60 vars in 1322 bytes} [Wed Jul 13 21:13:05 2022] POST /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 13 21:13:05.717654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ce503c13-dce1-425b-b394-f9d080b71b2f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:05.718743 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ce503c13-dce1-425b-b394-f9d080b71b2f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:05.724946 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ce503c13-dce1-425b-b394-f9d080b71b2f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:05.725385 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ce503c13-dce1-425b-b394-f9d080b71b2f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:05.726321 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ce503c13-dce1-425b-b394-f9d080b71b2f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:05.726559 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ce503c13-dce1-425b-b394-f9d080b71b2f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:05.755140 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ce503c13-dce1-425b-b394-f9d080b71b2f tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041258 Jul 13 21:13:05.755691 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 477/941] 10.222.0.39 () {58 vars in 1301 bytes} [Wed Jul 13 21:13:05 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:13:05.757453 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-5efd5c51-05df-4633-8cd1-b3404e5005e3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:05.757947 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-5efd5c51-05df-4633-8cd1-b3404e5005e3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:05.764890 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5efd5c51-05df-4633-8cd1-b3404e5005e3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:05.765337 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5efd5c51-05df-4633-8cd1-b3404e5005e3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:05.766099 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5efd5c51-05df-4633-8cd1-b3404e5005e3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:05.766536 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5efd5c51-05df-4633-8cd1-b3404e5005e3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:05.844168 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.objects.instance [None req-5efd5c51-05df-4633-8cd1-b3404e5005e3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lazy-loading 'services' on Instance uuid 823dc842-377a-4438-a1c5-73b5cce4cda2 {{(pid=118444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:13:05.916889 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-5efd5c51-05df-4633-8cd1-b3404e5005e3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "DELETE /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2/os-volume_attachments/3df5de29-7ab6-46f4-add7-07f52f7e942f" status: 202 len: 0 microversion: 2.1 time: 0.163192 Jul 13 21:13:05.922652 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 465/942] 10.222.0.39 () {58 vars in 1415 bytes} [Wed Jul 13 21:13:05 2022] DELETE /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2/os-volume_attachments/3df5de29-7ab6-46f4-add7-07f52f7e942f => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 13 21:13:05.932419 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-0c40aa30-88e3-4000-afdd-232f5425ac2a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:05.933354 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-0c40aa30-88e3-4000-afdd-232f5425ac2a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:05.940483 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0c40aa30-88e3-4000-afdd-232f5425ac2a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:05.940935 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0c40aa30-88e3-4000-afdd-232f5425ac2a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:05.941704 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0c40aa30-88e3-4000-afdd-232f5425ac2a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:05.942137 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0c40aa30-88e3-4000-afdd-232f5425ac2a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:05.972686 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-0c40aa30-88e3-4000-afdd-232f5425ac2a tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045042 Jul 13 21:13:05.973290 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 478/943] 10.222.0.39 () {58 vars in 1301 bytes} [Wed Jul 13 21:13:05 2022] GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:13:06.769365 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-32d98cb4-352a-4d0d-a6ae-818ce01bbb51 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:06.770443 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-32d98cb4-352a-4d0d-a6ae-818ce01bbb51 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:06.777078 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-32d98cb4-352a-4d0d-a6ae-818ce01bbb51 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:06.777520 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-32d98cb4-352a-4d0d-a6ae-818ce01bbb51 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:06.778284 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-32d98cb4-352a-4d0d-a6ae-818ce01bbb51 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:06.778726 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-32d98cb4-352a-4d0d-a6ae-818ce01bbb51 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:06.806766 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-32d98cb4-352a-4d0d-a6ae-818ce01bbb51 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042197 Jul 13 21:13:06.807306 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 466/944] 10.222.0.39 () {58 vars in 1301 bytes} [Wed Jul 13 21:13:06 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 13 21:13:06.880723 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-7fc21608-636b-4102-ab8b-920b067407b6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:06.881256 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-7fc21608-636b-4102-ab8b-920b067407b6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:06.888592 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7fc21608-636b-4102-ab8b-920b067407b6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:06.889095 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7fc21608-636b-4102-ab8b-920b067407b6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:06.889802 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7fc21608-636b-4102-ab8b-920b067407b6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:06.890229 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7fc21608-636b-4102-ab8b-920b067407b6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:06.916486 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-7fc21608-636b-4102-ab8b-920b067407b6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Going to try to terminate instance {{(pid=118445) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 21:13:06.984550 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-4ea9444b-c10c-4bcb-b737-00ba7f601e75 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:06.985700 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-4ea9444b-c10c-4bcb-b737-00ba7f601e75 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:06.992074 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-7fc21608-636b-4102-ab8b-920b067407b6 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "DELETE /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 204 len: 0 microversion: 2.1 time: 0.114760 Jul 13 21:13:06.992237 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4ea9444b-c10c-4bcb-b737-00ba7f601e75 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:06.992770 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4ea9444b-c10c-4bcb-b737-00ba7f601e75 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:06.992908 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 479/945] 10.222.0.39 () {58 vars in 1238 bytes} [Wed Jul 13 21:13:06 2022] DELETE /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 21:13:06.994010 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4ea9444b-c10c-4bcb-b737-00ba7f601e75 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:06.994552 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4ea9444b-c10c-4bcb-b737-00ba7f601e75 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:07.001006 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-f262a06d-a0d2-46d6-9a98-2c526f31a607 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:07.001689 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-f262a06d-a0d2-46d6-9a98-2c526f31a607 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:07.007494 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f262a06d-a0d2-46d6-9a98-2c526f31a607 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:07.007931 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f262a06d-a0d2-46d6-9a98-2c526f31a607 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:07.009228 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f262a06d-a0d2-46d6-9a98-2c526f31a607 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:07.009943 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f262a06d-a0d2-46d6-9a98-2c526f31a607 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:07.025063 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-4ea9444b-c10c-4bcb-b737-00ba7f601e75 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043969 Jul 13 21:13:07.025628 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 467/946] 10.222.0.39 () {58 vars in 1301 bytes} [Wed Jul 13 21:13:06 2022] GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 13 21:13:07.082646 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-12882c38-f1bd-4798-83fe-04d6e75ba267 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:07.083152 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-12882c38-f1bd-4798-83fe-04d6e75ba267 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:07.089721 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-12882c38-f1bd-4798-83fe-04d6e75ba267 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:07.090195 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-12882c38-f1bd-4798-83fe-04d6e75ba267 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:07.091049 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-12882c38-f1bd-4798-83fe-04d6e75ba267 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:07.091483 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-12882c38-f1bd-4798-83fe-04d6e75ba267 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:07.115791 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-12882c38-f1bd-4798-83fe-04d6e75ba267 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Going to try to terminate instance {{(pid=118444) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 21:13:07.147544 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-f262a06d-a0d2-46d6-9a98-2c526f31a607 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:07.155765 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-f262a06d-a0d2-46d6-9a98-2c526f31a607 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1691 microversion: 2.1 time: 0.158700 Jul 13 21:13:07.156391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 480/947] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:06 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:13:07.192855 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-12882c38-f1bd-4798-83fe-04d6e75ba267 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "DELETE /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2" status: 204 len: 0 microversion: 2.1 time: 0.113765 Jul 13 21:13:07.193398 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 468/948] 10.222.0.39 () {58 vars in 1238 bytes} [Wed Jul 13 21:13:07 2022] DELETE /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 13 21:13:07.201350 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-37985549-6758-4d1a-9744-f2773d288785 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:07.201957 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-37985549-6758-4d1a-9744-f2773d288785 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:07.207937 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-37985549-6758-4d1a-9744-f2773d288785 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:07.208384 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-37985549-6758-4d1a-9744-f2773d288785 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:07.209138 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-37985549-6758-4d1a-9744-f2773d288785 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:07.209576 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-37985549-6758-4d1a-9744-f2773d288785 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:07.338830 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-37985549-6758-4d1a-9744-f2773d288785 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:07.346190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-37985549-6758-4d1a-9744-f2773d288785 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2" status: 200 len: 1679 microversion: 2.1 time: 0.148580 Jul 13 21:13:07.346798 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 481/949] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:07 2022] GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:13:08.174059 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-c35f3c5b-ca48-492f-a6c4-5a0f2a8fba05 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:08.174735 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-c35f3c5b-ca48-492f-a6c4-5a0f2a8fba05 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:08.181705 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c35f3c5b-ca48-492f-a6c4-5a0f2a8fba05 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:08.182151 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c35f3c5b-ca48-492f-a6c4-5a0f2a8fba05 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:08.182948 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c35f3c5b-ca48-492f-a6c4-5a0f2a8fba05 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:08.183387 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c35f3c5b-ca48-492f-a6c4-5a0f2a8fba05 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:08.310351 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-c35f3c5b-ca48-492f-a6c4-5a0f2a8fba05 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:08.317732 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-c35f3c5b-ca48-492f-a6c4-5a0f2a8fba05 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1691 microversion: 2.1 time: 0.147972 Jul 13 21:13:08.318285 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 469/950] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:08 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1691 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:13:08.363742 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-b56228bf-53e2-492a-baa7-476441711d8c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:08.364342 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-b56228bf-53e2-492a-baa7-476441711d8c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:08.371580 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b56228bf-53e2-492a-baa7-476441711d8c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:08.372027 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b56228bf-53e2-492a-baa7-476441711d8c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:08.372789 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b56228bf-53e2-492a-baa7-476441711d8c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:08.373221 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b56228bf-53e2-492a-baa7-476441711d8c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:08.496852 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b56228bf-53e2-492a-baa7-476441711d8c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:08.504237 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-b56228bf-53e2-492a-baa7-476441711d8c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2" status: 200 len: 1679 microversion: 2.1 time: 0.144320 Jul 13 21:13:08.504807 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 482/951] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:08 2022] GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2 => generated 1679 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:13:09.335231 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-a4ca8490-9e4a-4fba-b394-81abc8f75dc8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:09.335830 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-a4ca8490-9e4a-4fba-b394-81abc8f75dc8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:09.342329 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a4ca8490-9e4a-4fba-b394-81abc8f75dc8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:09.342810 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a4ca8490-9e4a-4fba-b394-81abc8f75dc8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:09.343563 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a4ca8490-9e4a-4fba-b394-81abc8f75dc8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:09.343996 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a4ca8490-9e4a-4fba-b394-81abc8f75dc8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:09.472444 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-a4ca8490-9e4a-4fba-b394-81abc8f75dc8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:09.480636 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-a4ca8490-9e4a-4fba-b394-81abc8f75dc8 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1691 microversion: 2.1 time: 0.149209 Jul 13 21:13:09.481197 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 470/952] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:09 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1691 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:13:09.520408 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-f18552d5-4383-4a9d-b97a-2fd7b47717fe tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:09.521008 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-f18552d5-4383-4a9d-b97a-2fd7b47717fe tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:09.527937 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f18552d5-4383-4a9d-b97a-2fd7b47717fe tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:09.528322 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f18552d5-4383-4a9d-b97a-2fd7b47717fe tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:09.529071 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f18552d5-4383-4a9d-b97a-2fd7b47717fe tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:09.529494 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f18552d5-4383-4a9d-b97a-2fd7b47717fe tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:09.659479 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-f18552d5-4383-4a9d-b97a-2fd7b47717fe tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:09.667468 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-f18552d5-4383-4a9d-b97a-2fd7b47717fe tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2" status: 200 len: 1679 microversion: 2.1 time: 0.150877 Jul 13 21:13:09.668030 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 483/953] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:09 2022] GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:13:10.497695 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-c76bc4ac-9afc-414e-a889-6a74e3a416ed tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:10.498298 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-c76bc4ac-9afc-414e-a889-6a74e3a416ed tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:10.504715 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c76bc4ac-9afc-414e-a889-6a74e3a416ed tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:10.505160 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c76bc4ac-9afc-414e-a889-6a74e3a416ed tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:10.505928 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c76bc4ac-9afc-414e-a889-6a74e3a416ed tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:10.506347 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c76bc4ac-9afc-414e-a889-6a74e3a416ed tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:10.630135 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-c76bc4ac-9afc-414e-a889-6a74e3a416ed tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:10.637696 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-c76bc4ac-9afc-414e-a889-6a74e3a416ed tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1691 microversion: 2.1 time: 0.143865 Jul 13 21:13:10.638257 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 471/954] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:10 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1691 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:13:10.684797 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-a83d96d8-5116-432e-a24e-04d38ebd01a7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:10.685395 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-a83d96d8-5116-432e-a24e-04d38ebd01a7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:10.691762 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a83d96d8-5116-432e-a24e-04d38ebd01a7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:10.692202 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a83d96d8-5116-432e-a24e-04d38ebd01a7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:10.692950 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a83d96d8-5116-432e-a24e-04d38ebd01a7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:10.693378 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a83d96d8-5116-432e-a24e-04d38ebd01a7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:10.819815 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-a83d96d8-5116-432e-a24e-04d38ebd01a7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:10.827167 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-a83d96d8-5116-432e-a24e-04d38ebd01a7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2" status: 200 len: 1679 microversion: 2.1 time: 0.146756 Jul 13 21:13:10.827932 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 484/955] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:10 2022] GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2 => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:13:11.655287 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-e9facd0d-571b-4b27-bdc8-6b75a64743eb tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:11.655926 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-e9facd0d-571b-4b27-bdc8-6b75a64743eb tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:11.662403 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e9facd0d-571b-4b27-bdc8-6b75a64743eb tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:11.662882 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e9facd0d-571b-4b27-bdc8-6b75a64743eb tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:11.663640 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e9facd0d-571b-4b27-bdc8-6b75a64743eb tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:11.664078 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e9facd0d-571b-4b27-bdc8-6b75a64743eb tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:11.790714 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-e9facd0d-571b-4b27-bdc8-6b75a64743eb tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:11.798120 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-e9facd0d-571b-4b27-bdc8-6b75a64743eb tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1691 microversion: 2.1 time: 0.146684 Jul 13 21:13:11.798698 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 472/956] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:11 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1691 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:13:11.844020 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-8d99bce2-0c06-484c-98b5-c121c1e470a3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:11.844618 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8d99bce2-0c06-484c-98b5-c121c1e470a3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:11.850967 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8d99bce2-0c06-484c-98b5-c121c1e470a3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:11.851404 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8d99bce2-0c06-484c-98b5-c121c1e470a3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:11.852171 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8d99bce2-0c06-484c-98b5-c121c1e470a3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:11.852601 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8d99bce2-0c06-484c-98b5-c121c1e470a3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:11.978206 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8d99bce2-0c06-484c-98b5-c121c1e470a3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:11.985611 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-8d99bce2-0c06-484c-98b5-c121c1e470a3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2" status: 200 len: 1679 microversion: 2.1 time: 0.145375 Jul 13 21:13:11.986169 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 485/957] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:11 2022] GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2 => generated 1679 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:13:12.815679 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-1e962572-dbc0-4c26-90b8-e5d07f20b669 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:12.816412 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-1e962572-dbc0-4c26-90b8-e5d07f20b669 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:12.823204 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1e962572-dbc0-4c26-90b8-e5d07f20b669 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:12.823657 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1e962572-dbc0-4c26-90b8-e5d07f20b669 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:12.824441 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1e962572-dbc0-4c26-90b8-e5d07f20b669 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:12.824884 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1e962572-dbc0-4c26-90b8-e5d07f20b669 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:13.003777 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-8bffef9e-1148-498b-bbc0-68cdcac5dd56 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:13.004340 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8bffef9e-1148-498b-bbc0-68cdcac5dd56 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:13.011732 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8bffef9e-1148-498b-bbc0-68cdcac5dd56 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:13.012175 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8bffef9e-1148-498b-bbc0-68cdcac5dd56 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:13.012948 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8bffef9e-1148-498b-bbc0-68cdcac5dd56 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:13.013546 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8bffef9e-1148-498b-bbc0-68cdcac5dd56 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:13.159267 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8bffef9e-1148-498b-bbc0-68cdcac5dd56 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:13.166720 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-8bffef9e-1148-498b-bbc0-68cdcac5dd56 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2" status: 200 len: 1679 microversion: 2.1 time: 0.166903 Jul 13 21:13:13.167279 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 486/958] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:12 2022] GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:13:13.404544 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-1e962572-dbc0-4c26-90b8-e5d07f20b669 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:13.412056 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-1e962572-dbc0-4c26-90b8-e5d07f20b669 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1691 microversion: 2.1 time: 0.600204 Jul 13 21:13:13.412617 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 473/959] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:12 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1691 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:13:14.071943 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-e8133c4d-3c69-4eaa-84b5-1917c579e64f req-39973b3c-d4e1-4881-a183-c7f907d0da4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e5ee85-86cb-4ee9-9002-22ded6b91cdd", "name": "network-vif-deleted", "tag": "b2e4f436-9a2c-40fa-b1c8-e749b75a70b9"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:13:14.096102 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-e8133c4d-3c69-4eaa-84b5-1917c579e64f req-39973b3c-d4e1-4881-a183-c7f907d0da4c service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:14.096543 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-e8133c4d-3c69-4eaa-84b5-1917c579e64f req-39973b3c-d4e1-4881-a183-c7f907d0da4c service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:14.122992 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-e8133c4d-3c69-4eaa-84b5-1917c579e64f req-39973b3c-d4e1-4881-a183-c7f907d0da4c service nova] Creating event network-vif-deleted:b2e4f436-9a2c-40fa-b1c8-e749b75a70b9 for instance 84e5ee85-86cb-4ee9-9002-22ded6b91cdd on hv-cinder-79987 Jul 13 21:13:14.132066 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-e8133c4d-3c69-4eaa-84b5-1917c579e64f req-39973b3c-d4e1-4881-a183-c7f907d0da4c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063652 Jul 13 21:13:14.137644 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 487/960] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:13:14.184450 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-d51b4916-2d8b-4bf7-bd9d-150cc719a85b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:14.185746 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-d51b4916-2d8b-4bf7-bd9d-150cc719a85b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:14.196361 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d51b4916-2d8b-4bf7-bd9d-150cc719a85b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:14.199305 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d51b4916-2d8b-4bf7-bd9d-150cc719a85b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:14.200336 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d51b4916-2d8b-4bf7-bd9d-150cc719a85b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:14.200791 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d51b4916-2d8b-4bf7-bd9d-150cc719a85b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:14.318280 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-d51b4916-2d8b-4bf7-bd9d-150cc719a85b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:14.327772 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-d51b4916-2d8b-4bf7-bd9d-150cc719a85b tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2" status: 200 len: 1611 microversion: 2.1 time: 0.147189 Jul 13 21:13:14.328347 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 474/961] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:14 2022] GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2 => generated 1611 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:13:14.429519 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-30613e2a-f21a-44cc-a3ac-200dea82b1a5 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:14.430885 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-30613e2a-f21a-44cc-a3ac-200dea82b1a5 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:14.439142 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-30613e2a-f21a-44cc-a3ac-200dea82b1a5 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:14.439944 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-30613e2a-f21a-44cc-a3ac-200dea82b1a5 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:14.441098 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-30613e2a-f21a-44cc-a3ac-200dea82b1a5 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:14.441669 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-30613e2a-f21a-44cc-a3ac-200dea82b1a5 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:14.496653 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-30613e2a-f21a-44cc-a3ac-200dea82b1a5 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:14.497198 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-30613e2a-f21a-44cc-a3ac-200dea82b1a5 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:14.497860 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.objects.instance [None req-30613e2a-f21a-44cc-a3ac-200dea82b1a5 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lazy-loading 'fault' on Instance uuid 84e5ee85-86cb-4ee9-9002-22ded6b91cdd {{(pid=118445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:13:14.541960 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-30613e2a-f21a-44cc-a3ac-200dea82b1a5 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:14.547353 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:13:14.553790 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-30613e2a-f21a-44cc-a3ac-200dea82b1a5 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 200 len: 1336 microversion: 2.1 time: 0.128888 Jul 13 21:13:14.564235 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 488/962] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:14 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 1336 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:13:15.344759 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-787ab5ef-f929-4af6-a565-2faa4170d80e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:15.346689 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-787ab5ef-f929-4af6-a565-2faa4170d80e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:15.354322 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-787ab5ef-f929-4af6-a565-2faa4170d80e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:15.354904 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-787ab5ef-f929-4af6-a565-2faa4170d80e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:15.355956 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-787ab5ef-f929-4af6-a565-2faa4170d80e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:15.356626 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-787ab5ef-f929-4af6-a565-2faa4170d80e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:15.397665 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-787ab5ef-f929-4af6-a565-2faa4170d80e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:15.398126 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-787ab5ef-f929-4af6-a565-2faa4170d80e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:15.399446 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.objects.instance [None req-787ab5ef-f929-4af6-a565-2faa4170d80e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lazy-loading 'fault' on Instance uuid 823dc842-377a-4438-a1c5-73b5cce4cda2 {{(pid=118444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:13:15.402386 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:13:15.447585 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-787ab5ef-f929-4af6-a565-2faa4170d80e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:15.463336 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-787ab5ef-f929-4af6-a565-2faa4170d80e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2" status: 200 len: 1330 microversion: 2.1 time: 0.122247 Jul 13 21:13:15.474226 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 475/963] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:15 2022] GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2 => generated 1330 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:13:15.572092 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-59fd8ad1-f041-4d14-9988-aa993ce71c96 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:15.572689 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-59fd8ad1-f041-4d14-9988-aa993ce71c96 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 84e5ee85-86cb-4ee9-9002-22ded6b91cdd] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:15.580376 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-59fd8ad1-f041-4d14-9988-aa993ce71c96 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:15.580819 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-59fd8ad1-f041-4d14-9988-aa993ce71c96 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:15.581575 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-59fd8ad1-f041-4d14-9988-aa993ce71c96 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:15.581999 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-59fd8ad1-f041-4d14-9988-aa993ce71c96 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:15.595326 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.wsgi [None req-59fd8ad1-f041-4d14-9988-aa993ce71c96 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] HTTP exception thrown: Instance 84e5ee85-86cb-4ee9-9002-22ded6b91cdd could not be found. Jul 13 21:13:15.596936 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-59fd8ad1-f041-4d14-9988-aa993ce71c96 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Request method failure captured: Jul 13 21:13:15.596936 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: request: GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd HTTP/1.1 Jul 13 21:13:15.596936 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept: application/json Jul 13 21:13:15.596936 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept-Encoding: identity Jul 13 21:13:15.596936 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Connection: close Jul 13 21:13:15.596936 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Length: 0 Jul 13 21:13:15.596936 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Type: application/json Jul 13 21:13:15.596936 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Host: 10.222.0.39 Jul 13 21:13:15.596936 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Openstack-System-Scope: None Jul 13 21:13:15.596936 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: User-Agent: python-urllib3/1.26.9 Jul 13 21:13:15.596936 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Auth-Token: gAAAAABizzPtXHqQhWpxQh2KXbvi9Mgpby3iRjpl1OJ_e5HYVB22nvOaYbWB2MpVdcW6zYVpUTz-raJVgo1KpIKJjd8jQvSDDnfI08IVf2HZpBBPAsy36vIdZqbCwpfLiW8Y5tS--8G7qgwaLY75cvFnltcDSVPPHdqKdNVl_OBtO9Qz2UoyQNk Jul 13 21:13:15.596936 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Id: None Jul 13 21:13:15.596936 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Name: None Jul 13 21:13:15.596936 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Identity-Status: Confirmed Jul 13 21:13:15.596936 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Is-Admin-Project: True Jul 13 21:13:15.596936 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Id: default Jul 13 21:13:15.596936 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Name: Default Jul 13 21:13:15.596936 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Id: c1d4119a1d0b474fb568818f1aaa933b Jul 13 21:13:15.596936 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-156399502 Jul 13 21:13:15.596936 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Role: member,reader Jul 13 21:13:15.596936 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Roles: member,reader Jul 13 21:13:15.598492 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c1d4119a1d0b474fb568818f1aaa933b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c1d4119a1d0b474fb568818f1aaa933b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c1d4119a1d0b474fb568818f1aaa933b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c1d4119a1d0b474fb568818f1aaa933b"}]}] Jul 13 21:13:15.598492 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant: tempest-ServerRescueNegativeTestJSON-156399502 Jul 13 21:13:15.598492 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Id: c1d4119a1d0b474fb568818f1aaa933b Jul 13 21:13:15.598492 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-156399502 Jul 13 21:13:15.598492 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User: tempest-ServerRescueNegativeTestJSON-156399502-project Jul 13 21:13:15.598492 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Id: default Jul 13 21:13:15.598492 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Name: Default Jul 13 21:13:15.598492 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Id: dc40c07fceab4a83ba9324da868034aa Jul 13 21:13:15.598492 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Name: tempest-ServerRescueNegativeTestJSON-156399502-project Jul 13 21:13:15.598492 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: method: > Jul 13 21:13:15.598492 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: exception: Instance 84e5ee85-86cb-4ee9-9002-22ded6b91cdd could not be found. Jul 13 21:13:15.598492 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: action_args: {'id': '84e5ee85-86cb-4ee9-9002-22ded6b91cdd'} Jul 13 21:13:15.599415 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:13:15.599415 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:15.599415 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:13:15.599415 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:13:15.599415 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:13:15.599415 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:13:15.599415 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:13:15.599415 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:13:15.599415 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:13:15.599415 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:13:15.599415 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84e5ee85-86cb-4ee9-9002-22ded6b91cdd could not be found. Jul 13 21:13:15.599415 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:15.599415 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:13:15.599415 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:15.599415 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:15.599415 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:13:15.599415 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:13:15.599415 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:13:15.599415 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:13:15.599415 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:13:15.600912 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:13:15.600912 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 21:13:15.600912 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 21:13:15.600912 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:13:15.600912 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:13:15.600912 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:13:15.600912 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:13:15.600912 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84e5ee85-86cb-4ee9-9002-22ded6b91cdd could not be found. Jul 13 21:13:15.600912 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:15.600912 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:13:15.600912 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:15.600912 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:15.600912 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:13:15.600912 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:13:15.600912 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:13:15.600912 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:13:15.600912 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84e5ee85-86cb-4ee9-9002-22ded6b91cdd could not be found. Jul 13 21:13:15.600912 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:15.602282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-59fd8ad1-f041-4d14-9988-aa993ce71c96 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Returning 404 to user: Instance 84e5ee85-86cb-4ee9-9002-22ded6b91cdd could not be found. {{(pid=118445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:13:15.602282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-59fd8ad1-f041-4d14-9988-aa993ce71c96 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd" status: 404 len: 111 microversion: 2.1 time: 0.030977 Jul 13 21:13:15.602282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 489/964] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:15 2022] GET /compute/v2.1/servers/84e5ee85-86cb-4ee9-9002-22ded6b91cdd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:13:15.607171 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-3854352a-c761-49e9-8543-f80f1264f6ab tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '.version_select at 0x7f96e8704ee0>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:15.624634 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-3854352a-c761-49e9-8543-f80f1264f6ab tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1216158299" status: 202 len: 0 microversion: 2.1 time: 0.021141 Jul 13 21:13:15.625189 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 476/965] 10.222.0.39 () {58 vars in 1220 bytes} [Wed Jul 13 21:13:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1216158299 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 21:13:16.166413 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-978c740a-1694-471e-a5cb-3429551eaeba req-cb76cb18-a410-4327-bed6-c495a4b649c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "823dc842-377a-4438-a1c5-73b5cce4cda2", "name": "network-vif-deleted", "tag": "4d6adae4-d0db-4e04-bfb6-7912631d40c4"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:13:16.174582 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-978c740a-1694-471e-a5cb-3429551eaeba req-cb76cb18-a410-4327-bed6-c495a4b649c9 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:16.175114 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-978c740a-1694-471e-a5cb-3429551eaeba req-cb76cb18-a410-4327-bed6-c495a4b649c9 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:16.189082 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-978c740a-1694-471e-a5cb-3429551eaeba req-cb76cb18-a410-4327-bed6-c495a4b649c9 service nova] Creating event network-vif-deleted:4d6adae4-d0db-4e04-bfb6-7912631d40c4 for instance 823dc842-377a-4438-a1c5-73b5cce4cda2 on hv-cinder-79987 Jul 13 21:13:16.193799 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-978c740a-1694-471e-a5cb-3429551eaeba req-cb76cb18-a410-4327-bed6-c495a4b649c9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031540 Jul 13 21:13:16.194377 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 490/966] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:13:16.482370 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-c49f754d-b1e1-410a-9eda-225fcd76b18c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:16.482932 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-c49f754d-b1e1-410a-9eda-225fcd76b18c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:16.488843 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c49f754d-b1e1-410a-9eda-225fcd76b18c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:16.489290 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c49f754d-b1e1-410a-9eda-225fcd76b18c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:16.490049 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c49f754d-b1e1-410a-9eda-225fcd76b18c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:16.490513 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c49f754d-b1e1-410a-9eda-225fcd76b18c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:16.503581 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.wsgi [None req-c49f754d-b1e1-410a-9eda-225fcd76b18c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] HTTP exception thrown: Instance 823dc842-377a-4438-a1c5-73b5cce4cda2 could not be found. Jul 13 21:13:16.505192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-c49f754d-b1e1-410a-9eda-225fcd76b18c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Request method failure captured: Jul 13 21:13:16.505192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: request: GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2 HTTP/1.1 Jul 13 21:13:16.505192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept: application/json Jul 13 21:13:16.505192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept-Encoding: identity Jul 13 21:13:16.505192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Connection: close Jul 13 21:13:16.505192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Length: 0 Jul 13 21:13:16.505192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Type: application/json Jul 13 21:13:16.505192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Host: 10.222.0.39 Jul 13 21:13:16.505192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Openstack-System-Scope: None Jul 13 21:13:16.505192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: User-Agent: python-urllib3/1.26.9 Jul 13 21:13:16.505192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Auth-Token: gAAAAABizzNqbt1i7chwFPcQAba6b9dk7TD8_G2l_XT7jQopf9IFAZNKmztmBJ4IISK_ds_GpyDLtbYZUS7JtctAPU-Tk1Sa5a4_tbywXB6GjEvdott7LmC4oiwINlLKkOc-EI-NfdeC0sCeq7QrJd1h1pR8691UeSBeFVmfqq10_09s26cRblc Jul 13 21:13:16.505192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Id: None Jul 13 21:13:16.505192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Name: None Jul 13 21:13:16.505192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Identity-Status: Confirmed Jul 13 21:13:16.505192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Is-Admin-Project: True Jul 13 21:13:16.505192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Id: default Jul 13 21:13:16.505192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Name: Default Jul 13 21:13:16.505192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Id: 0a2703a8b75043e0ab0656482fa9ddeb Jul 13 21:13:16.505192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Name: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:13:16.505192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Role: member,reader Jul 13 21:13:16.505192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Roles: member,reader Jul 13 21:13:16.506695 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a2703a8b75043e0ab0656482fa9ddeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0a2703a8b75043e0ab0656482fa9ddeb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0a2703a8b75043e0ab0656482fa9ddeb", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a2703a8b75043e0ab0656482fa9ddeb"}]}] Jul 13 21:13:16.506695 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:13:16.506695 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Id: 0a2703a8b75043e0ab0656482fa9ddeb Jul 13 21:13:16.506695 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:13:16.506695 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User: tempest-AttachVolumeNegativeTest-334916766-project Jul 13 21:13:16.506695 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Id: default Jul 13 21:13:16.506695 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Name: Default Jul 13 21:13:16.506695 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Id: d9cab6f67cd34c46886d036ba170331e Jul 13 21:13:16.506695 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Name: tempest-AttachVolumeNegativeTest-334916766-project Jul 13 21:13:16.506695 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: method: > Jul 13 21:13:16.506695 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: exception: Instance 823dc842-377a-4438-a1c5-73b5cce4cda2 could not be found. Jul 13 21:13:16.506695 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: action_args: {'id': '823dc842-377a-4438-a1c5-73b5cce4cda2'} Jul 13 21:13:16.507588 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:13:16.507588 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:16.507588 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:13:16.507588 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:13:16.507588 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:13:16.507588 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:13:16.507588 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:13:16.507588 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:13:16.507588 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:13:16.507588 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:13:16.507588 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 823dc842-377a-4438-a1c5-73b5cce4cda2 could not be found. Jul 13 21:13:16.507588 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:13:16.507588 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:13:16.507588 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:13:16.507588 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:16.507588 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:13:16.507588 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:13:16.507588 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:13:16.507588 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:13:16.507588 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:13:16.508912 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:13:16.508912 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 21:13:16.508912 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 21:13:16.508912 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:13:16.508912 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:13:16.508912 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:13:16.508912 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:13:16.508912 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 823dc842-377a-4438-a1c5-73b5cce4cda2 could not be found. Jul 13 21:13:16.508912 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:13:16.508912 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:13:16.508912 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:13:16.508912 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:16.508912 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:13:16.508912 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:13:16.508912 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:13:16.508912 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:13:16.508912 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 823dc842-377a-4438-a1c5-73b5cce4cda2 could not be found. Jul 13 21:13:16.508912 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:13:16.510423 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-c49f754d-b1e1-410a-9eda-225fcd76b18c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Returning 404 to user: Instance 823dc842-377a-4438-a1c5-73b5cce4cda2 could not be found. {{(pid=118444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:13:16.510423 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-c49f754d-b1e1-410a-9eda-225fcd76b18c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2" status: 404 len: 111 microversion: 2.1 time: 0.028610 Jul 13 21:13:16.510423 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 477/967] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:16 2022] GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:13:16.516062 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-f92ddb13-df5c-4071-82fa-a27ed2c353a8 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '.version_select at 0x7f96e89b4e50>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:16.533599 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-f92ddb13-df5c-4071-82fa-a27ed2c353a8 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-22635791" status: 202 len: 0 microversion: 2.1 time: 0.021582 Jul 13 21:13:16.534139 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 491/968] 10.222.0.39 () {58 vars in 1214 bytes} [Wed Jul 13 21:13:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-22635791 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 21:13:17.140393 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-14be042c-9db1-4eaf-afaf-c91ffc630f6d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Action: 'create', calling method: .version_select at 0x7f96e863c310>, body: {"keypair": {"name": "tempest-keypair-142931986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLz1+Yw+/+7+3m0fM/u4MiBgoaz9aSSSCpcT+K7TsKVcU+sBn/bbMleOcwJwlkh1VtFm3tg5IUqr1MTMEId2buf5yyjD7jHg9wEWjsF3iJG4BOoZe4SsTQeNwgaCqYwX8Q=="}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:13:17.154118 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.quota [None req-14be042c-9db1-4eaf-afaf-c91ffc630f6d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Getting quotas for project 0a2703a8b75043e0ab0656482fa9ddeb. Resources: {'key_pairs'} {{(pid=118444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:13:17.157890 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.quota [None req-14be042c-9db1-4eaf-afaf-c91ffc630f6d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Getting quotas for user d9cab6f67cd34c46886d036ba170331e and project 0a2703a8b75043e0ab0656482fa9ddeb. Resources: {'key_pairs'} {{(pid=118444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:13:17.178544 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-14be042c-9db1-4eaf-afaf-c91ffc630f6d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.042196 Jul 13 21:13:17.179146 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 478/969] 10.222.0.39 () {60 vars in 1158 bytes} [Wed Jul 13 21:13:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:13:18.468301 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-856c1387-0cef-4ff3-b417-54fa655166b3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1161659147", "imageRef": "5a995c88-d784-4a51-a6b9-25aa9dfe607c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0724e09-98b0-4f74-b483-93b3266239e7"}], "security_groups": [{"name": "tempest-securitygroup--1824558975"}], "key_name": "tempest-keypair-142931986", "user_data": "}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:13:18.479528 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-790bb21e-d532-4b0b-b560-b068895ca737 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:18.480017 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-790bb21e-d532-4b0b-b560-b068895ca737 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:18.485914 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-790bb21e-d532-4b0b-b560-b068895ca737 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:18.486359 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-790bb21e-d532-4b0b-b560-b068895ca737 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:18.487147 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-790bb21e-d532-4b0b-b560-b068895ca737 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:18.487764 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-790bb21e-d532-4b0b-b560-b068895ca737 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:18.513684 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-790bb21e-d532-4b0b-b560-b068895ca737 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Going to try to terminate instance {{(pid=118444) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 21:13:18.575712 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.network.neutron [None req-856c1387-0cef-4ff3-b417-54fa655166b3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] validate_networks() for [('b0724e09-98b0-4f74-b483-93b3266239e7', None, None, None, None, None)] {{(pid=118445) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 21:13:18.591432 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-790bb21e-d532-4b0b-b560-b068895ca737 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "DELETE /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 204 len: 0 microversion: 2.1 time: 0.115942 Jul 13 21:13:18.595186 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 479/970] 10.222.0.39 () {58 vars in 1238 bytes} [Wed Jul 13 21:13:18 2022] DELETE /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 13 21:13:18.601062 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-990696e6-26be-48a0-8fac-0ae7407a8fbe tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:18.601982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-990696e6-26be-48a0-8fac-0ae7407a8fbe tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:18.609858 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-990696e6-26be-48a0-8fac-0ae7407a8fbe tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:18.610308 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-990696e6-26be-48a0-8fac-0ae7407a8fbe tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:18.611121 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-990696e6-26be-48a0-8fac-0ae7407a8fbe tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:18.611562 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-990696e6-26be-48a0-8fac-0ae7407a8fbe tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:18.748650 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-990696e6-26be-48a0-8fac-0ae7407a8fbe tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:18.756171 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-990696e6-26be-48a0-8fac-0ae7407a8fbe tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1507 microversion: 2.1 time: 0.159412 Jul 13 21:13:18.756744 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 480/971] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:18 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:13:18.953384 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-856c1387-0cef-4ff3-b417-54fa655166b3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Flavor limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 21:13:18.953800 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-856c1387-0cef-4ff3-b417-54fa655166b3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Image limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 21:13:18.954283 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-856c1387-0cef-4ff3-b417-54fa655166b3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Flavor pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 21:13:18.954709 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-856c1387-0cef-4ff3-b417-54fa655166b3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Image pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 21:13:18.955112 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-856c1387-0cef-4ff3-b417-54fa655166b3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 21:13:18.963855 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-856c1387-0cef-4ff3-b417-54fa655166b3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:18.964237 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-856c1387-0cef-4ff3-b417-54fa655166b3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:18.965016 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-856c1387-0cef-4ff3-b417-54fa655166b3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:18.965458 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-856c1387-0cef-4ff3-b417-54fa655166b3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:18.981841 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-856c1387-0cef-4ff3-b417-54fa655166b3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Getting quotas for project 0a2703a8b75043e0ab0656482fa9ddeb. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:13:18.985700 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-856c1387-0cef-4ff3-b417-54fa655166b3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Getting quotas for user d9cab6f67cd34c46886d036ba170331e and project 0a2703a8b75043e0ab0656482fa9ddeb. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:13:18.996989 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-856c1387-0cef-4ff3-b417-54fa655166b3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Going to run 1 instances... {{(pid=118445) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 21:13:18.999299 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-856c1387-0cef-4ff3-b417-54fa655166b3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 22968c28-4691-4e3d-a9e9-dbc923b5fa93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995c88-d784-4a51-a6b9-25aa9dfe607c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118445) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 21:13:19.044938 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-856c1387-0cef-4ff3-b417-54fa655166b3 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.581535 Jul 13 21:13:19.045577 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 492/972] 10.222.0.39 () {60 vars in 1146 bytes} [Wed Jul 13 21:13:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 21:13:19.055841 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-942f6b52-4bf6-415b-8d12-f31e3ceb2255 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:19.056441 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-942f6b52-4bf6-415b-8d12-f31e3ceb2255 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 22968c28-4691-4e3d-a9e9-dbc923b5fa93] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:19.107818 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-942f6b52-4bf6-415b-8d12-f31e3ceb2255 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:19.116161 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-942f6b52-4bf6-415b-8d12-f31e3ceb2255 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93" status: 200 len: 1241 microversion: 2.1 time: 0.064604 Jul 13 21:13:19.116800 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 481/973] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:19 2022] GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:13:19.775157 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-1e2cd584-602a-48df-95cf-4fb03477100d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:19.775877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-1e2cd584-602a-48df-95cf-4fb03477100d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:19.783762 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1e2cd584-602a-48df-95cf-4fb03477100d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:19.784212 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1e2cd584-602a-48df-95cf-4fb03477100d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:19.784983 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1e2cd584-602a-48df-95cf-4fb03477100d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:19.785415 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1e2cd584-602a-48df-95cf-4fb03477100d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:19.916326 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-1e2cd584-602a-48df-95cf-4fb03477100d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:19.923749 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-1e2cd584-602a-48df-95cf-4fb03477100d tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 200 len: 1507 microversion: 2.1 time: 0.154404 Jul 13 21:13:19.924311 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 493/974] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:19 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:13:20.028805 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-00bc903c-688c-4a5a-b735-b90b67728f41 req-db0008d0-c75a-4e80-b330-cc1d1fd624e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77562fb4-e9e7-411b-bf21-3a8d3f8f0cea", "name": "network-vif-deleted", "tag": "14306988-fa76-49d8-91c1-ef2b82d04f8b"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:13:20.038678 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-00bc903c-688c-4a5a-b735-b90b67728f41 req-db0008d0-c75a-4e80-b330-cc1d1fd624e7 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:20.039173 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-00bc903c-688c-4a5a-b735-b90b67728f41 req-db0008d0-c75a-4e80-b330-cc1d1fd624e7 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:20.049556 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-00bc903c-688c-4a5a-b735-b90b67728f41 req-db0008d0-c75a-4e80-b330-cc1d1fd624e7 service nova] Creating event network-vif-deleted:14306988-fa76-49d8-91c1-ef2b82d04f8b for instance 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea on hv-cinder-79987 Jul 13 21:13:20.054338 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-00bc903c-688c-4a5a-b735-b90b67728f41 req-db0008d0-c75a-4e80-b330-cc1d1fd624e7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029295 Jul 13 21:13:20.055480 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 482/975] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:13:20.135006 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-3f53dc36-adcf-486b-a531-e3665ced409e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:20.135704 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-3f53dc36-adcf-486b-a531-e3665ced409e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 22968c28-4691-4e3d-a9e9-dbc923b5fa93] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:20.141923 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3f53dc36-adcf-486b-a531-e3665ced409e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:20.142367 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3f53dc36-adcf-486b-a531-e3665ced409e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:20.143374 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3f53dc36-adcf-486b-a531-e3665ced409e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:20.143811 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3f53dc36-adcf-486b-a531-e3665ced409e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:20.211424 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3f53dc36-adcf-486b-a531-e3665ced409e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:20.219358 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-3f53dc36-adcf-486b-a531-e3665ced409e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93" status: 200 len: 1293 microversion: 2.1 time: 0.089478 Jul 13 21:13:20.220103 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 494/976] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:20 2022] GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93 => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:13:20.941799 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-2ac8ffee-d4dc-472a-9ef3-419cb707cbd7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:20.942493 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-2ac8ffee-d4dc-472a-9ef3-419cb707cbd7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:20.948816 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2ac8ffee-d4dc-472a-9ef3-419cb707cbd7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:20.949267 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2ac8ffee-d4dc-472a-9ef3-419cb707cbd7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:20.950027 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2ac8ffee-d4dc-472a-9ef3-419cb707cbd7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:20.950461 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2ac8ffee-d4dc-472a-9ef3-419cb707cbd7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:20.964177 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.wsgi [None req-2ac8ffee-d4dc-472a-9ef3-419cb707cbd7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] HTTP exception thrown: Instance 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea could not be found. Jul 13 21:13:20.965816 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-2ac8ffee-d4dc-472a-9ef3-419cb707cbd7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Request method failure captured: Jul 13 21:13:20.965816 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: request: GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea HTTP/1.1 Jul 13 21:13:20.965816 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept: application/json Jul 13 21:13:20.965816 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept-Encoding: identity Jul 13 21:13:20.965816 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Connection: close Jul 13 21:13:20.965816 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Length: 0 Jul 13 21:13:20.965816 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Type: application/json Jul 13 21:13:20.965816 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Host: 10.222.0.39 Jul 13 21:13:20.965816 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Openstack-System-Scope: None Jul 13 21:13:20.965816 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: User-Agent: python-urllib3/1.26.9 Jul 13 21:13:20.965816 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Auth-Token: gAAAAABizzPtXHqQhWpxQh2KXbvi9Mgpby3iRjpl1OJ_e5HYVB22nvOaYbWB2MpVdcW6zYVpUTz-raJVgo1KpIKJjd8jQvSDDnfI08IVf2HZpBBPAsy36vIdZqbCwpfLiW8Y5tS--8G7qgwaLY75cvFnltcDSVPPHdqKdNVl_OBtO9Qz2UoyQNk Jul 13 21:13:20.965816 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Id: None Jul 13 21:13:20.965816 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Name: None Jul 13 21:13:20.965816 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Identity-Status: Confirmed Jul 13 21:13:20.965816 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Is-Admin-Project: True Jul 13 21:13:20.965816 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Id: default Jul 13 21:13:20.965816 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Name: Default Jul 13 21:13:20.965816 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Id: c1d4119a1d0b474fb568818f1aaa933b Jul 13 21:13:20.965816 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-156399502 Jul 13 21:13:20.965816 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Role: member,reader Jul 13 21:13:20.965816 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Roles: member,reader Jul 13 21:13:20.967412 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c1d4119a1d0b474fb568818f1aaa933b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c1d4119a1d0b474fb568818f1aaa933b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c1d4119a1d0b474fb568818f1aaa933b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c1d4119a1d0b474fb568818f1aaa933b"}]}] Jul 13 21:13:20.967412 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant: tempest-ServerRescueNegativeTestJSON-156399502 Jul 13 21:13:20.967412 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Id: c1d4119a1d0b474fb568818f1aaa933b Jul 13 21:13:20.967412 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-156399502 Jul 13 21:13:20.967412 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User: tempest-ServerRescueNegativeTestJSON-156399502-project Jul 13 21:13:20.967412 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Id: default Jul 13 21:13:20.967412 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Name: Default Jul 13 21:13:20.967412 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Id: dc40c07fceab4a83ba9324da868034aa Jul 13 21:13:20.967412 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Name: tempest-ServerRescueNegativeTestJSON-156399502-project Jul 13 21:13:20.967412 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: method: > Jul 13 21:13:20.967412 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: exception: Instance 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea could not be found. Jul 13 21:13:20.967412 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: action_args: {'id': '77562fb4-e9e7-411b-bf21-3a8d3f8f0cea'} Jul 13 21:13:20.968139 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:13:20.968139 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:20.968139 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:13:20.968139 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:13:20.968139 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:13:20.968139 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:13:20.968139 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:13:20.968139 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:13:20.968139 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:13:20.968139 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:13:20.968139 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea could not be found. Jul 13 21:13:20.968139 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:13:20.968139 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:13:20.968139 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:13:20.968139 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:20.968139 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:13:20.968139 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:13:20.968139 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:13:20.968139 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:13:20.968139 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:13:20.969387 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:13:20.969387 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 21:13:20.969387 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 21:13:20.969387 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:13:20.969387 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:13:20.969387 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:13:20.969387 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:13:20.969387 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea could not be found. Jul 13 21:13:20.969387 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:13:20.969387 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:13:20.969387 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:13:20.969387 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:20.969387 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:13:20.969387 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:13:20.969387 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:13:20.969387 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:13:20.969387 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea could not be found. Jul 13 21:13:20.969387 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:13:20.970498 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-2ac8ffee-d4dc-472a-9ef3-419cb707cbd7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Returning 404 to user: Instance 77562fb4-e9e7-411b-bf21-3a8d3f8f0cea could not be found. {{(pid=118444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:13:20.970498 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-2ac8ffee-d4dc-472a-9ef3-419cb707cbd7 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea" status: 404 len: 111 microversion: 2.1 time: 0.030241 Jul 13 21:13:20.970498 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 483/977] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:20 2022] GET /compute/v2.1/servers/77562fb4-e9e7-411b-bf21-3a8d3f8f0cea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:13:20.977199 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-16978ef3-974c-4f7e-941c-84034714bc43 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:20.977690 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-16978ef3-974c-4f7e-941c-84034714bc43 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:20.984160 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-16978ef3-974c-4f7e-941c-84034714bc43 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:20.984604 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-16978ef3-974c-4f7e-941c-84034714bc43 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:20.985367 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-16978ef3-974c-4f7e-941c-84034714bc43 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:20.985800 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-16978ef3-974c-4f7e-941c-84034714bc43 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:21.011988 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-16978ef3-974c-4f7e-941c-84034714bc43 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Going to try to terminate instance {{(pid=118445) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 21:13:21.094978 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-16978ef3-974c-4f7e-941c-84034714bc43 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 204 len: 0 microversion: 2.1 time: 0.122781 Jul 13 21:13:21.095807 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 495/978] 10.222.0.39 () {58 vars in 1238 bytes} [Wed Jul 13 21:13:20 2022] DELETE /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 21:13:21.104855 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-39a9bcba-5086-4b8f-a07b-227bbb753f6e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:21.105468 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-39a9bcba-5086-4b8f-a07b-227bbb753f6e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:21.112913 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-39a9bcba-5086-4b8f-a07b-227bbb753f6e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:21.113962 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-39a9bcba-5086-4b8f-a07b-227bbb753f6e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:21.115582 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-39a9bcba-5086-4b8f-a07b-227bbb753f6e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:21.116084 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-39a9bcba-5086-4b8f-a07b-227bbb753f6e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:21.210245 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-8c59b09c-886f-4114-a941-eda46e95810e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:21.210869 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8c59b09c-886f-4114-a941-eda46e95810e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:21.217408 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8c59b09c-886f-4114-a941-eda46e95810e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:21.217877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8c59b09c-886f-4114-a941-eda46e95810e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:21.218654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8c59b09c-886f-4114-a941-eda46e95810e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:21.219089 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8c59b09c-886f-4114-a941-eda46e95810e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:21.242566 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-8c59b09c-886f-4114-a941-eda46e95810e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811/ips" status: 200 len: 151 microversion: 2.20 time: 0.036528 Jul 13 21:13:21.243173 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 496/979] 10.222.0.39 () {60 vars in 1288 bytes} [Wed Jul 13 21:13:21 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 21:13:21.247665 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-615549a5-209e-4106-869c-3724d5aa0c03 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:21.248261 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-615549a5-209e-4106-869c-3724d5aa0c03 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 22968c28-4691-4e3d-a9e9-dbc923b5fa93] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:21.255889 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-615549a5-209e-4106-869c-3724d5aa0c03 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:21.256333 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-615549a5-209e-4106-869c-3724d5aa0c03 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:21.257090 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-615549a5-209e-4106-869c-3724d5aa0c03 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:21.257517 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-615549a5-209e-4106-869c-3724d5aa0c03 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:21.329408 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-39a9bcba-5086-4b8f-a07b-227bbb753f6e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:21.338697 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-39a9bcba-5086-4b8f-a07b-227bbb753f6e tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1522 microversion: 2.1 time: 0.238373 Jul 13 21:13:21.347823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 484/980] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:21 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:13:21.425630 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-615549a5-209e-4106-869c-3724d5aa0c03 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:21.449356 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-615549a5-209e-4106-869c-3724d5aa0c03 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93" status: 200 len: 1367 microversion: 2.1 time: 0.204948 Jul 13 21:13:21.449948 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 497/981] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:21 2022] GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:13:22.356318 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-940af357-3969-41ca-a902-aede4ccdc445 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:22.356916 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-940af357-3969-41ca-a902-aede4ccdc445 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:22.362880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-940af357-3969-41ca-a902-aede4ccdc445 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:22.363322 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-940af357-3969-41ca-a902-aede4ccdc445 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:22.364071 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-940af357-3969-41ca-a902-aede4ccdc445 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:22.364513 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-940af357-3969-41ca-a902-aede4ccdc445 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:22.466403 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-daf7c517-b12b-4fc8-91ab-ad175902cd97 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:22.467130 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-daf7c517-b12b-4fc8-91ab-ad175902cd97 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 22968c28-4691-4e3d-a9e9-dbc923b5fa93] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:22.473664 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-daf7c517-b12b-4fc8-91ab-ad175902cd97 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:22.474190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-daf7c517-b12b-4fc8-91ab-ad175902cd97 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:22.475083 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-daf7c517-b12b-4fc8-91ab-ad175902cd97 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:22.475590 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-daf7c517-b12b-4fc8-91ab-ad175902cd97 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:22.489509 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-940af357-3969-41ca-a902-aede4ccdc445 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:22.497414 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-940af357-3969-41ca-a902-aede4ccdc445 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1522 microversion: 2.1 time: 0.145176 Jul 13 21:13:22.497972 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 485/982] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:22 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:13:22.600808 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-daf7c517-b12b-4fc8-91ab-ad175902cd97 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:22.609292 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-daf7c517-b12b-4fc8-91ab-ad175902cd97 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93" status: 200 len: 1367 microversion: 2.1 time: 0.146759 Jul 13 21:13:22.609849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 498/983] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:22 2022] GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:13:23.092939 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-bd1d01c8-f8bd-4c1a-8179-5960c3247628 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:13:23.093495 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-bd1d01c8-f8bd-4c1a-8179-5960c3247628 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:23.099479 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bd1d01c8-f8bd-4c1a-8179-5960c3247628 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:23.099943 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bd1d01c8-f8bd-4c1a-8179-5960c3247628 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:23.101097 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bd1d01c8-f8bd-4c1a-8179-5960c3247628 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:23.101097 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bd1d01c8-f8bd-4c1a-8179-5960c3247628 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:23.124957 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.objects.instance [None req-bd1d01c8-f8bd-4c1a-8179-5960c3247628 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lazy-loading 'flavor' on Instance uuid d49b390c-173a-4b3b-b9ac-dc1afce64811 {{(pid=118444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:13:23.383102 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-bd1d01c8-f8bd-4c1a-8179-5960c3247628 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "POST /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811/action" status: 202 len: 0 microversion: 2.20 time: 0.293325 Jul 13 21:13:23.386875 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 486/984] 10.222.0.39 () {62 vars in 1318 bytes} [Wed Jul 13 21:13:23 2022] POST /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 13 21:13:23.392607 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-4080241a-365a-47ca-a5f5-fb4f51fa8f63 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:23.393220 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-4080241a-365a-47ca-a5f5-fb4f51fa8f63 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:23.400280 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4080241a-365a-47ca-a5f5-fb4f51fa8f63 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:23.400727 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4080241a-365a-47ca-a5f5-fb4f51fa8f63 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:23.401503 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4080241a-365a-47ca-a5f5-fb4f51fa8f63 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:23.401967 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4080241a-365a-47ca-a5f5-fb4f51fa8f63 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:23.515878 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ce779957-f89b-4cc4-b59d-8c0af8ae066b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:23.516698 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-ce779957-f89b-4cc4-b59d-8c0af8ae066b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:23.524209 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ce779957-f89b-4cc4-b59d-8c0af8ae066b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:23.524791 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ce779957-f89b-4cc4-b59d-8c0af8ae066b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:23.525648 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ce779957-f89b-4cc4-b59d-8c0af8ae066b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:23.526156 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ce779957-f89b-4cc4-b59d-8c0af8ae066b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:23.561190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-4080241a-365a-47ca-a5f5-fb4f51fa8f63 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:23.569670 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-4080241a-365a-47ca-a5f5-fb4f51fa8f63 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:23.572491 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-4080241a-365a-47ca-a5f5-fb4f51fa8f63 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:23.573683 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-4080241a-365a-47ca-a5f5-fb4f51fa8f63 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1722 microversion: 2.20 time: 0.185049 Jul 13 21:13:23.574241 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 499/985] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:23 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:13:23.626957 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-97593f81-3cdd-4a25-ba0f-9c3216a9b0ac tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:23.627476 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-97593f81-3cdd-4a25-ba0f-9c3216a9b0ac tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 22968c28-4691-4e3d-a9e9-dbc923b5fa93] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:23.634245 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-97593f81-3cdd-4a25-ba0f-9c3216a9b0ac tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:23.634732 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-97593f81-3cdd-4a25-ba0f-9c3216a9b0ac tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:23.635501 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-97593f81-3cdd-4a25-ba0f-9c3216a9b0ac tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:23.635949 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-97593f81-3cdd-4a25-ba0f-9c3216a9b0ac tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:23.767466 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-97593f81-3cdd-4a25-ba0f-9c3216a9b0ac tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:23.769203 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ce779957-f89b-4cc4-b59d-8c0af8ae066b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:23.775580 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-97593f81-3cdd-4a25-ba0f-9c3216a9b0ac tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93" status: 200 len: 1367 microversion: 2.1 time: 0.152836 Jul 13 21:13:23.776224 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 500/986] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:23 2022] GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:13:23.777464 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ce779957-f89b-4cc4-b59d-8c0af8ae066b tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1522 microversion: 2.1 time: 0.265834 Jul 13 21:13:23.778020 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 487/987] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:23 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:13:24.297427 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-9e9a9e2c-3e29-42c4-a9c5-ff40bf296f90 req-6e66ac43-c879-4a06-8f7d-c1a3199546e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22968c28-4691-4e3d-a9e9-dbc923b5fa93", "tag": "821c0e73-63a8-4070-abbf-6531a9c1abc6"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:13:24.317485 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-9e9a9e2c-3e29-42c4-a9c5-ff40bf296f90 req-6e66ac43-c879-4a06-8f7d-c1a3199546e2 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:24.317992 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-9e9a9e2c-3e29-42c4-a9c5-ff40bf296f90 req-6e66ac43-c879-4a06-8f7d-c1a3199546e2 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:24.330800 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-9e9a9e2c-3e29-42c4-a9c5-ff40bf296f90 req-6e66ac43-c879-4a06-8f7d-c1a3199546e2 service nova] Creating event network-changed:821c0e73-63a8-4070-abbf-6531a9c1abc6 for instance 22968c28-4691-4e3d-a9e9-dbc923b5fa93 on hv-cinder-79987 Jul 13 21:13:24.335956 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-9e9a9e2c-3e29-42c4-a9c5-ff40bf296f90 req-6e66ac43-c879-4a06-8f7d-c1a3199546e2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042788 Jul 13 21:13:24.337202 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 501/988] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:13:24.592994 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-8e86d721-bd7e-4087-a150-0a205d649f54 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:24.593698 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-8e86d721-bd7e-4087-a150-0a205d649f54 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:24.600453 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8e86d721-bd7e-4087-a150-0a205d649f54 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:24.601004 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8e86d721-bd7e-4087-a150-0a205d649f54 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:24.602833 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8e86d721-bd7e-4087-a150-0a205d649f54 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:24.603366 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8e86d721-bd7e-4087-a150-0a205d649f54 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:24.793676 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-6399f0ac-c0d2-472b-a5a1-c316fce205cc tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:24.794517 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-6399f0ac-c0d2-472b-a5a1-c316fce205cc tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 22968c28-4691-4e3d-a9e9-dbc923b5fa93] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:24.801380 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6399f0ac-c0d2-472b-a5a1-c316fce205cc tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:24.801915 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6399f0ac-c0d2-472b-a5a1-c316fce205cc tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:24.802707 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6399f0ac-c0d2-472b-a5a1-c316fce205cc tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:24.803143 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6399f0ac-c0d2-472b-a5a1-c316fce205cc tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:24.830709 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-8e86d721-bd7e-4087-a150-0a205d649f54 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:24.839629 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-8e86d721-bd7e-4087-a150-0a205d649f54 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:24.841141 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-8e86d721-bd7e-4087-a150-0a205d649f54 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:24.842293 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-8e86d721-bd7e-4087-a150-0a205d649f54 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1722 microversion: 2.20 time: 0.253387 Jul 13 21:13:24.853040 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 488/989] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:24 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:13:24.853040 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-61bf21cc-b1de-4812-bdd3-d0c99c353254 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:24.853040 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-61bf21cc-b1de-4812-bdd3-d0c99c353254 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:24.857112 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-61bf21cc-b1de-4812-bdd3-d0c99c353254 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:24.857639 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-61bf21cc-b1de-4812-bdd3-d0c99c353254 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:24.858487 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-61bf21cc-b1de-4812-bdd3-d0c99c353254 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:24.859160 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-61bf21cc-b1de-4812-bdd3-d0c99c353254 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:24.894482 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-61bf21cc-b1de-4812-bdd3-d0c99c353254 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:24.894964 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-61bf21cc-b1de-4812-bdd3-d0c99c353254 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:24.895426 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.objects.instance [None req-61bf21cc-b1de-4812-bdd3-d0c99c353254 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lazy-loading 'fault' on Instance uuid b0f6b2e3-dfe2-417f-a343-d2d9b990df70 {{(pid=118444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:13:24.938500 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-61bf21cc-b1de-4812-bdd3-d0c99c353254 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc40c07fceab4a83ba9324da868034aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d4119a1d0b474fb568818f1aaa933b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:24.938707 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-6399f0ac-c0d2-472b-a5a1-c316fce205cc tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:24.946778 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-61bf21cc-b1de-4812-bdd3-d0c99c353254 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 200 len: 1312 microversion: 2.1 time: 0.102863 Jul 13 21:13:24.947588 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 489/990] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:24 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 1312 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:13:24.952597 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-6399f0ac-c0d2-472b-a5a1-c316fce205cc tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93" status: 200 len: 1367 microversion: 2.1 time: 0.163711 Jul 13 21:13:24.953256 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 502/991] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:24 2022] GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:13:25.860649 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ca218b6f-d5b3-4c43-b6fa-07dfb8623e35 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:25.861258 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-ca218b6f-d5b3-4c43-b6fa-07dfb8623e35 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:25.868850 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ca218b6f-d5b3-4c43-b6fa-07dfb8623e35 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:25.869294 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ca218b6f-d5b3-4c43-b6fa-07dfb8623e35 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:25.870050 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ca218b6f-d5b3-4c43-b6fa-07dfb8623e35 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:25.870484 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ca218b6f-d5b3-4c43-b6fa-07dfb8623e35 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:25.964627 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-255c0f93-b606-4eb2-b16d-c216488eafa5 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:25.965331 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-255c0f93-b606-4eb2-b16d-c216488eafa5 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] [instance: b0f6b2e3-dfe2-417f-a343-d2d9b990df70] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:25.971998 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-255c0f93-b606-4eb2-b16d-c216488eafa5 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:25.972514 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-255c0f93-b606-4eb2-b16d-c216488eafa5 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:25.973336 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-255c0f93-b606-4eb2-b16d-c216488eafa5 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:25.973837 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-255c0f93-b606-4eb2-b16d-c216488eafa5 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:25.994048 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.wsgi [None req-255c0f93-b606-4eb2-b16d-c216488eafa5 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] HTTP exception thrown: Instance b0f6b2e3-dfe2-417f-a343-d2d9b990df70 could not be found. Jul 13 21:13:25.995980 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-255c0f93-b606-4eb2-b16d-c216488eafa5 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Request method failure captured: Jul 13 21:13:25.995980 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: request: GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 HTTP/1.1 Jul 13 21:13:25.995980 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept: application/json Jul 13 21:13:25.995980 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept-Encoding: identity Jul 13 21:13:25.995980 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Connection: close Jul 13 21:13:25.995980 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Length: 0 Jul 13 21:13:25.995980 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Type: application/json Jul 13 21:13:25.995980 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Host: 10.222.0.39 Jul 13 21:13:25.995980 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Openstack-System-Scope: None Jul 13 21:13:25.995980 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: User-Agent: python-urllib3/1.26.9 Jul 13 21:13:25.995980 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Auth-Token: gAAAAABizzPtXHqQhWpxQh2KXbvi9Mgpby3iRjpl1OJ_e5HYVB22nvOaYbWB2MpVdcW6zYVpUTz-raJVgo1KpIKJjd8jQvSDDnfI08IVf2HZpBBPAsy36vIdZqbCwpfLiW8Y5tS--8G7qgwaLY75cvFnltcDSVPPHdqKdNVl_OBtO9Qz2UoyQNk Jul 13 21:13:25.995980 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Id: None Jul 13 21:13:25.995980 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Name: None Jul 13 21:13:25.995980 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Identity-Status: Confirmed Jul 13 21:13:25.995980 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Is-Admin-Project: True Jul 13 21:13:25.995980 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Id: default Jul 13 21:13:25.995980 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Name: Default Jul 13 21:13:25.995980 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Id: c1d4119a1d0b474fb568818f1aaa933b Jul 13 21:13:25.995980 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-156399502 Jul 13 21:13:25.995980 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Role: member,reader Jul 13 21:13:25.995980 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Roles: member,reader Jul 13 21:13:25.997545 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c1d4119a1d0b474fb568818f1aaa933b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c1d4119a1d0b474fb568818f1aaa933b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c1d4119a1d0b474fb568818f1aaa933b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c1d4119a1d0b474fb568818f1aaa933b"}]}] Jul 13 21:13:25.997545 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant: tempest-ServerRescueNegativeTestJSON-156399502 Jul 13 21:13:25.997545 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Id: c1d4119a1d0b474fb568818f1aaa933b Jul 13 21:13:25.997545 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-156399502 Jul 13 21:13:25.997545 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User: tempest-ServerRescueNegativeTestJSON-156399502-project Jul 13 21:13:25.997545 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Id: default Jul 13 21:13:25.997545 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Name: Default Jul 13 21:13:25.997545 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Id: dc40c07fceab4a83ba9324da868034aa Jul 13 21:13:25.997545 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Name: tempest-ServerRescueNegativeTestJSON-156399502-project Jul 13 21:13:25.997545 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: method: > Jul 13 21:13:25.997545 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: exception: Instance b0f6b2e3-dfe2-417f-a343-d2d9b990df70 could not be found. Jul 13 21:13:25.997545 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: action_args: {'id': 'b0f6b2e3-dfe2-417f-a343-d2d9b990df70'} Jul 13 21:13:25.998381 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:13:25.998381 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:25.998381 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:13:25.998381 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:13:25.998381 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:13:25.998381 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:13:25.998381 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:13:25.998381 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:13:25.998381 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:13:25.998381 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:13:25.998381 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0f6b2e3-dfe2-417f-a343-d2d9b990df70 could not be found. Jul 13 21:13:25.998381 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:25.998381 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:13:25.998381 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:25.998381 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:25.998381 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:13:25.998381 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:13:25.998381 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:13:25.998381 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:13:25.998381 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:13:25.999806 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:13:25.999806 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 21:13:25.999806 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 21:13:25.999806 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:13:25.999806 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:13:25.999806 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:13:25.999806 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:13:25.999806 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0f6b2e3-dfe2-417f-a343-d2d9b990df70 could not be found. Jul 13 21:13:25.999806 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:25.999806 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:13:25.999806 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:25.999806 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:25.999806 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:13:25.999806 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:13:25.999806 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:13:25.999806 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:13:25.999806 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0f6b2e3-dfe2-417f-a343-d2d9b990df70 could not be found. Jul 13 21:13:25.999806 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:26.000877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-255c0f93-b606-4eb2-b16d-c216488eafa5 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] Returning 404 to user: Instance b0f6b2e3-dfe2-417f-a343-d2d9b990df70 could not be found. {{(pid=118445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:13:26.000967 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ca218b6f-d5b3-4c43-b6fa-07dfb8623e35 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:26.001065 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-255c0f93-b606-4eb2-b16d-c216488eafa5 tempest-ServerRescueNegativeTestJSON-156399502 tempest-ServerRescueNegativeTestJSON-156399502-project] 10.222.0.39 "GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70" status: 404 len: 111 microversion: 2.1 time: 0.037296 Jul 13 21:13:26.001065 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 503/992] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:25 2022] GET /compute/v2.1/servers/b0f6b2e3-dfe2-417f-a343-d2d9b990df70 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:13:26.003522 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ba07713d-3783-4e19-81fc-8d72fe236493 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:26.004942 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ba07713d-3783-4e19-81fc-8d72fe236493 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 22968c28-4691-4e3d-a9e9-dbc923b5fa93] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:26.011820 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ba07713d-3783-4e19-81fc-8d72fe236493 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:26.012265 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ba07713d-3783-4e19-81fc-8d72fe236493 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:26.013122 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ba07713d-3783-4e19-81fc-8d72fe236493 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:26.013755 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ba07713d-3783-4e19-81fc-8d72fe236493 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:26.019889 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ca218b6f-d5b3-4c43-b6fa-07dfb8623e35 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:26.022241 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ca218b6f-d5b3-4c43-b6fa-07dfb8623e35 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:26.023993 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ca218b6f-d5b3-4c43-b6fa-07dfb8623e35 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1722 microversion: 2.20 time: 0.167230 Jul 13 21:13:26.029607 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 490/993] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:25 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:13:26.146866 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ba07713d-3783-4e19-81fc-8d72fe236493 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:26.154863 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ba07713d-3783-4e19-81fc-8d72fe236493 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93" status: 200 len: 1367 microversion: 2.1 time: 0.155216 Jul 13 21:13:26.155457 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 504/994] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:25 2022] GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:13:26.350545 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-08f8a25c-f68c-4315-85af-0470d910f4aa req-e0e95d05-13d7-443e-acc3-49f398f483b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0f6b2e3-dfe2-417f-a343-d2d9b990df70", "name": "network-vif-deleted", "tag": "9f1a0181-71ef-4629-8374-dc5acba51596"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:13:26.358478 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-08f8a25c-f68c-4315-85af-0470d910f4aa req-e0e95d05-13d7-443e-acc3-49f398f483b9 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:26.358951 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-08f8a25c-f68c-4315-85af-0470d910f4aa req-e0e95d05-13d7-443e-acc3-49f398f483b9 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:26.369305 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-08f8a25c-f68c-4315-85af-0470d910f4aa req-e0e95d05-13d7-443e-acc3-49f398f483b9 service nova] Creating event network-vif-deleted:9f1a0181-71ef-4629-8374-dc5acba51596 for instance b0f6b2e3-dfe2-417f-a343-d2d9b990df70 on hv-cinder-79987 Jul 13 21:13:26.374369 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-08f8a25c-f68c-4315-85af-0470d910f4aa req-e0e95d05-13d7-443e-acc3-49f398f483b9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027415 Jul 13 21:13:26.375295 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 491/995] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:13:27.042793 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-7e8caad6-cd67-4e8f-8a4f-3bd073226f98 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:27.043357 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-7e8caad6-cd67-4e8f-8a4f-3bd073226f98 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:27.050061 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7e8caad6-cd67-4e8f-8a4f-3bd073226f98 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:27.050515 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7e8caad6-cd67-4e8f-8a4f-3bd073226f98 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:27.051343 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7e8caad6-cd67-4e8f-8a4f-3bd073226f98 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:27.051782 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7e8caad6-cd67-4e8f-8a4f-3bd073226f98 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:27.172367 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-00355bf1-5749-4e36-a13c-a85b0866b372 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:27.173094 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-00355bf1-5749-4e36-a13c-a85b0866b372 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 22968c28-4691-4e3d-a9e9-dbc923b5fa93] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:27.175596 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:13:27.182310 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-00355bf1-5749-4e36-a13c-a85b0866b372 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:27.182792 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-00355bf1-5749-4e36-a13c-a85b0866b372 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:27.183572 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-00355bf1-5749-4e36-a13c-a85b0866b372 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:27.184021 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-00355bf1-5749-4e36-a13c-a85b0866b372 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:27.297990 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-7e8caad6-cd67-4e8f-8a4f-3bd073226f98 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:27.307857 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-7e8caad6-cd67-4e8f-8a4f-3bd073226f98 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:27.309470 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-7e8caad6-cd67-4e8f-8a4f-3bd073226f98 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:27.310731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-7e8caad6-cd67-4e8f-8a4f-3bd073226f98 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1722 microversion: 2.20 time: 0.272043 Jul 13 21:13:27.311377 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 505/996] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:27 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1722 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:13:27.482865 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-00355bf1-5749-4e36-a13c-a85b0866b372 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:27.488104 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-00355bf1-5749-4e36-a13c-a85b0866b372 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93" status: 200 len: 1367 microversion: 2.1 time: 0.319818 Jul 13 21:13:27.497750 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 492/997] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:27 2022] GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93 => generated 1367 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:13:28.330822 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-07129b9c-3cb0-47c8-8065-04ce5ef58d9e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:28.331423 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-07129b9c-3cb0-47c8-8065-04ce5ef58d9e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:28.334855 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:13:28.345735 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-07129b9c-3cb0-47c8-8065-04ce5ef58d9e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:28.346186 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-07129b9c-3cb0-47c8-8065-04ce5ef58d9e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:28.347271 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-07129b9c-3cb0-47c8-8065-04ce5ef58d9e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:28.348004 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-07129b9c-3cb0-47c8-8065-04ce5ef58d9e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:28.501017 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-07129b9c-3cb0-47c8-8065-04ce5ef58d9e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:28.506024 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-741c948f-b9ad-4137-85e5-021c7e9cce96 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:28.506797 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-741c948f-b9ad-4137-85e5-021c7e9cce96 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 22968c28-4691-4e3d-a9e9-dbc923b5fa93] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:28.513761 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-07129b9c-3cb0-47c8-8065-04ce5ef58d9e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:28.514395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-741c948f-b9ad-4137-85e5-021c7e9cce96 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:28.514965 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-741c948f-b9ad-4137-85e5-021c7e9cce96 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:28.515970 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-741c948f-b9ad-4137-85e5-021c7e9cce96 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:28.516169 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-07129b9c-3cb0-47c8-8065-04ce5ef58d9e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:28.516536 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-741c948f-b9ad-4137-85e5-021c7e9cce96 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:28.517336 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-07129b9c-3cb0-47c8-8065-04ce5ef58d9e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1722 microversion: 2.20 time: 0.190449 Jul 13 21:13:28.518662 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 506/998] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:28 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:13:28.756304 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-741c948f-b9ad-4137-85e5-021c7e9cce96 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:28.760247 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:13:28.765543 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-741c948f-b9ad-4137-85e5-021c7e9cce96 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93" status: 200 len: 1367 microversion: 2.1 time: 0.264559 Jul 13 21:13:28.766113 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 493/999] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:28 2022] GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93 => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:13:29.535654 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-0fddfadd-f358-4e56-8443-020d044347ef tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:29.536298 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-0fddfadd-f358-4e56-8443-020d044347ef tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:29.544769 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=2 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:13:29.545456 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=6 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:13:29.554362 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0fddfadd-f358-4e56-8443-020d044347ef tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:29.554840 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0fddfadd-f358-4e56-8443-020d044347ef tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:29.555612 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0fddfadd-f358-4e56-8443-020d044347ef tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:29.556073 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0fddfadd-f358-4e56-8443-020d044347ef tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:29.736533 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-0fddfadd-f358-4e56-8443-020d044347ef tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:29.745917 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-0fddfadd-f358-4e56-8443-020d044347ef tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:29.747828 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-0fddfadd-f358-4e56-8443-020d044347ef tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:29.749549 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-0fddfadd-f358-4e56-8443-020d044347ef tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1722 microversion: 2.20 time: 0.217510 Jul 13 21:13:29.750220 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 507/1000] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:29 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:13:29.783350 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-e09072e0-2789-437e-90c3-580e0cea43a9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:29.783969 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-e09072e0-2789-437e-90c3-580e0cea43a9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 22968c28-4691-4e3d-a9e9-dbc923b5fa93] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:29.787940 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell0:SELECT=6 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:13:29.793820 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e09072e0-2789-437e-90c3-580e0cea43a9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:29.794478 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e09072e0-2789-437e-90c3-580e0cea43a9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:29.795280 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e09072e0-2789-437e-90c3-580e0cea43a9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:29.795707 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e09072e0-2789-437e-90c3-580e0cea43a9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:29.896502 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-851d1108-5d0c-4366-a008-e74aa30301d9 req-e0cd9bab-f254-428c-bb35-ce9f2aacc5e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22968c28-4691-4e3d-a9e9-dbc923b5fa93", "name": "network-vif-plugged", "status": "completed", "tag": "821c0e73-63a8-4070-abbf-6531a9c1abc6"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:13:29.905340 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-851d1108-5d0c-4366-a008-e74aa30301d9 req-e0cd9bab-f254-428c-bb35-ce9f2aacc5e3 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:29.905786 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-851d1108-5d0c-4366-a008-e74aa30301d9 req-e0cd9bab-f254-428c-bb35-ce9f2aacc5e3 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:29.917708 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-851d1108-5d0c-4366-a008-e74aa30301d9 req-e0cd9bab-f254-428c-bb35-ce9f2aacc5e3 service nova] Creating event network-vif-plugged:821c0e73-63a8-4070-abbf-6531a9c1abc6 for instance 22968c28-4691-4e3d-a9e9-dbc923b5fa93 on hv-cinder-79987 Jul 13 21:13:29.925287 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-851d1108-5d0c-4366-a008-e74aa30301d9 req-e0cd9bab-f254-428c-bb35-ce9f2aacc5e3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030664 Jul 13 21:13:29.925287 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 508/1001] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:13:29.981008 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-e09072e0-2789-437e-90c3-580e0cea43a9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:29.990138 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-e09072e0-2789-437e-90c3-580e0cea43a9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93" status: 200 len: 1367 microversion: 2.1 time: 0.210965 Jul 13 21:13:29.990990 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 494/1002] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:29 2022] GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:13:30.769881 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-eb44064e-a290-4f5e-8215-641c10e12649 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:30.771004 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-eb44064e-a290-4f5e-8215-641c10e12649 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:30.777853 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eb44064e-a290-4f5e-8215-641c10e12649 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:30.778592 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eb44064e-a290-4f5e-8215-641c10e12649 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:30.779471 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eb44064e-a290-4f5e-8215-641c10e12649 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:30.779819 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eb44064e-a290-4f5e-8215-641c10e12649 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:30.806278 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-b20fa339-7bfd-41a3-9a6f-b6893ce0c83b tempest-VolumesNegativeTest-454002636 tempest-VolumesNegativeTest-454002636-project] Action: 'create', calling method: .version_select at 0x7f96e88b6160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-719674238", "metadata": {"Type": "work"}}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:13:30.828897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-b20fa339-7bfd-41a3-9a6f-b6893ce0c83b tempest-VolumesNegativeTest-454002636 tempest-VolumesNegativeTest-454002636-project] Request method failure captured: Jul 13 21:13:30.828897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 13 21:13:30.828897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept: application/json Jul 13 21:13:30.828897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept-Encoding: identity Jul 13 21:13:30.828897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Connection: close Jul 13 21:13:30.828897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Length: 121 Jul 13 21:13:30.828897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Type: application/json Jul 13 21:13:30.828897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Host: 10.222.0.39 Jul 13 21:13:30.828897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Openstack-System-Scope: None Jul 13 21:13:30.828897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: User-Agent: python-urllib3/1.26.9 Jul 13 21:13:30.828897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Auth-Token: gAAAAABizzV69ON85XJkOWnHEyupeBuMAJKjOhRornnLndDvwc6u4vLBDV2DeEVrpst4_1DsIobFTpJNl6jNmLlL9tXuqF9SgCV5a2a0jnSvBiIvCOC4t7ygPe7dUhTWD128rn9l6KtdEd1E5nVuvcvzg1xOngq53fanop69vj4Jg1YVnZgCcm8 Jul 13 21:13:30.828897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Id: None Jul 13 21:13:30.828897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Name: None Jul 13 21:13:30.828897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Identity-Status: Confirmed Jul 13 21:13:30.828897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Is-Admin-Project: True Jul 13 21:13:30.828897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Id: default Jul 13 21:13:30.828897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Name: Default Jul 13 21:13:30.828897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Id: ac0722fdade14d0ab5dcdbeb33ea4a11 Jul 13 21:13:30.828897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Name: tempest-VolumesNegativeTest-454002636 Jul 13 21:13:30.828897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Role: member,reader Jul 13 21:13:30.828897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Roles: member,reader Jul 13 21:13:30.830188 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac0722fdade14d0ab5dcdbeb33ea4a11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ac0722fdade14d0ab5dcdbeb33ea4a11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ac0722fdade14d0ab5dcdbeb33ea4a11", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac0722fdade14d0ab5dcdbeb33ea4a11"}]}] Jul 13 21:13:30.830188 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant: tempest-VolumesNegativeTest-454002636 Jul 13 21:13:30.830188 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Id: ac0722fdade14d0ab5dcdbeb33ea4a11 Jul 13 21:13:30.830188 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Name: tempest-VolumesNegativeTest-454002636 Jul 13 21:13:30.830188 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User: tempest-VolumesNegativeTest-454002636-project Jul 13 21:13:30.830188 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Id: default Jul 13 21:13:30.830188 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Name: Default Jul 13 21:13:30.830188 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Id: c2c1e768cd7247de9895b492550af64a Jul 13 21:13:30.830188 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Name: tempest-VolumesNegativeTest-454002636-project Jul 13 21:13:30.830188 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Jul 13 21:13:30.830188 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-719674238", "metadata": {"Type": "work"}}} Jul 13 21:13:30.830188 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: method: Jul 13 21:13:30.830188 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 13 21:13:30.831103 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-719674238', 'metadata': {'Type': 'work'}}}} Jul 13 21:13:30.831103 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:13:30.831103 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:30.831103 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 13 21:13:30.831103 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 13 21:13:30.831103 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 13 21:13:30.831103 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise error Jul 13 21:13:30.831103 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 13 21:13:30.831103 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.831103 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 13 21:13:30.831103 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 13 21:13:30.831103 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.831103 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 13 21:13:30.831103 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi '#$%' Jul 13 21:13:30.831103 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.831103 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:13:30.831103 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.831103 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:30.831103 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:13:30.831103 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:13:30.831103 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:13:30.831103 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:13:30.832834 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 13 21:13:30.832834 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 13 21:13:30.832834 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:13:30.832834 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:13:30.832834 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 13 21:13:30.832834 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 13 21:13:30.832834 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 13 21:13:30.832834 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 13 21:13:30.832834 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 13 21:13:30.832834 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 13 21:13:30.832834 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 13 21:13:30.832834 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.832834 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:13:30.832834 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.832834 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:30.832834 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:13:30.832834 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:13:30.832834 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 13 21:13:30.832834 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 13 21:13:30.834245 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 13 21:13:30.834245 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.834245 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-b20fa339-7bfd-41a3-9a6f-b6893ce0c83b tempest-VolumesNegativeTest-454002636 tempest-VolumesNegativeTest-454002636-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:13:30.834245 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-b20fa339-7bfd-41a3-9a6f-b6893ce0c83b tempest-VolumesNegativeTest-454002636 tempest-VolumesNegativeTest-454002636-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.165787 Jul 13 21:13:30.834245 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 509/1003] 10.222.0.39 () {60 vars in 1155 bytes} [Wed Jul 13 21:13:30 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 13 21:13:30.841055 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-1209cceb-d06d-4741-9d54-5accb688ba66 tempest-VolumesNegativeTest-454002636 tempest-VolumesNegativeTest-454002636-project] Action: 'create', calling method: .version_select at 0x7f96e89ba430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1593123216", "metadata": {"Type": "work"}}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:13:30.843791 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-1209cceb-d06d-4741-9d54-5accb688ba66 tempest-VolumesNegativeTest-454002636 tempest-VolumesNegativeTest-454002636-project] Request method failure captured: Jul 13 21:13:30.843791 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 13 21:13:30.843791 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept: application/json Jul 13 21:13:30.843791 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept-Encoding: identity Jul 13 21:13:30.843791 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Connection: close Jul 13 21:13:30.843791 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Length: 120 Jul 13 21:13:30.843791 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Type: application/json Jul 13 21:13:30.843791 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Host: 10.222.0.39 Jul 13 21:13:30.843791 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Openstack-System-Scope: None Jul 13 21:13:30.843791 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: User-Agent: python-urllib3/1.26.9 Jul 13 21:13:30.843791 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Auth-Token: gAAAAABizzV69ON85XJkOWnHEyupeBuMAJKjOhRornnLndDvwc6u4vLBDV2DeEVrpst4_1DsIobFTpJNl6jNmLlL9tXuqF9SgCV5a2a0jnSvBiIvCOC4t7ygPe7dUhTWD128rn9l6KtdEd1E5nVuvcvzg1xOngq53fanop69vj4Jg1YVnZgCcm8 Jul 13 21:13:30.843791 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Id: None Jul 13 21:13:30.843791 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Name: None Jul 13 21:13:30.843791 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Identity-Status: Confirmed Jul 13 21:13:30.843791 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Is-Admin-Project: True Jul 13 21:13:30.843791 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Id: default Jul 13 21:13:30.843791 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Name: Default Jul 13 21:13:30.843791 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Id: ac0722fdade14d0ab5dcdbeb33ea4a11 Jul 13 21:13:30.843791 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Name: tempest-VolumesNegativeTest-454002636 Jul 13 21:13:30.843791 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Role: member,reader Jul 13 21:13:30.843791 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Roles: member,reader Jul 13 21:13:30.845118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac0722fdade14d0ab5dcdbeb33ea4a11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ac0722fdade14d0ab5dcdbeb33ea4a11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ac0722fdade14d0ab5dcdbeb33ea4a11", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac0722fdade14d0ab5dcdbeb33ea4a11"}]}] Jul 13 21:13:30.845118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant: tempest-VolumesNegativeTest-454002636 Jul 13 21:13:30.845118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Id: ac0722fdade14d0ab5dcdbeb33ea4a11 Jul 13 21:13:30.845118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Name: tempest-VolumesNegativeTest-454002636 Jul 13 21:13:30.845118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User: tempest-VolumesNegativeTest-454002636-project Jul 13 21:13:30.845118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Id: default Jul 13 21:13:30.845118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Name: Default Jul 13 21:13:30.845118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Id: c2c1e768cd7247de9895b492550af64a Jul 13 21:13:30.845118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Name: tempest-VolumesNegativeTest-454002636-project Jul 13 21:13:30.845118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Jul 13 21:13:30.845118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1593123216", "metadata": {"Type": "work"}}} Jul 13 21:13:30.845118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: method: Jul 13 21:13:30.845118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 13 21:13:30.845897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1593123216', 'metadata': {'Type': 'work'}}}} Jul 13 21:13:30.845897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:13:30.845897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:30.845897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 13 21:13:30.845897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 13 21:13:30.845897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 13 21:13:30.845897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise error Jul 13 21:13:30.845897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 13 21:13:30.845897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.845897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 13 21:13:30.845897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 13 21:13:30.845897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.845897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 13 21:13:30.845897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi '0' Jul 13 21:13:30.845897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.845897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:13:30.845897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.845897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:30.845897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:13:30.845897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:13:30.845897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:13:30.845897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:13:30.847318 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 13 21:13:30.847318 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 13 21:13:30.847318 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:13:30.847318 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:13:30.847318 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 13 21:13:30.847318 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 13 21:13:30.847318 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 13 21:13:30.847318 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 13 21:13:30.847318 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 13 21:13:30.847318 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 13 21:13:30.847318 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 13 21:13:30.847318 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.847318 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:13:30.847318 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.847318 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:30.847318 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:13:30.847318 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:13:30.847318 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 13 21:13:30.847318 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 13 21:13:30.848408 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 13 21:13:30.848408 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.848408 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-1209cceb-d06d-4741-9d54-5accb688ba66 tempest-VolumesNegativeTest-454002636 tempest-VolumesNegativeTest-454002636-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:13:30.848408 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-1209cceb-d06d-4741-9d54-5accb688ba66 tempest-VolumesNegativeTest-454002636 tempest-VolumesNegativeTest-454002636-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008602 Jul 13 21:13:30.848408 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 510/1004] 10.222.0.39 () {60 vars in 1155 bytes} [Wed Jul 13 21:13:30 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 13 21:13:30.855853 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-37bab1f1-447e-407e-a585-40294af67173 tempest-VolumesNegativeTest-454002636 tempest-VolumesNegativeTest-454002636-project] Action: 'create', calling method: .version_select at 0x7f96e89ba040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-126575086", "metadata": {"Type": "work"}}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:13:30.858118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-37bab1f1-447e-407e-a585-40294af67173 tempest-VolumesNegativeTest-454002636 tempest-VolumesNegativeTest-454002636-project] Request method failure captured: Jul 13 21:13:30.858118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 13 21:13:30.858118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept: application/json Jul 13 21:13:30.858118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept-Encoding: identity Jul 13 21:13:30.858118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Connection: close Jul 13 21:13:30.858118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Length: 118 Jul 13 21:13:30.858118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Type: application/json Jul 13 21:13:30.858118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Host: 10.222.0.39 Jul 13 21:13:30.858118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Openstack-System-Scope: None Jul 13 21:13:30.858118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: User-Agent: python-urllib3/1.26.9 Jul 13 21:13:30.858118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Auth-Token: gAAAAABizzV69ON85XJkOWnHEyupeBuMAJKjOhRornnLndDvwc6u4vLBDV2DeEVrpst4_1DsIobFTpJNl6jNmLlL9tXuqF9SgCV5a2a0jnSvBiIvCOC4t7ygPe7dUhTWD128rn9l6KtdEd1E5nVuvcvzg1xOngq53fanop69vj4Jg1YVnZgCcm8 Jul 13 21:13:30.858118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Id: None Jul 13 21:13:30.858118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Name: None Jul 13 21:13:30.858118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Identity-Status: Confirmed Jul 13 21:13:30.858118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Is-Admin-Project: True Jul 13 21:13:30.858118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Id: default Jul 13 21:13:30.858118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Name: Default Jul 13 21:13:30.858118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Id: ac0722fdade14d0ab5dcdbeb33ea4a11 Jul 13 21:13:30.858118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Name: tempest-VolumesNegativeTest-454002636 Jul 13 21:13:30.858118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Role: member,reader Jul 13 21:13:30.858118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Roles: member,reader Jul 13 21:13:30.860440 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac0722fdade14d0ab5dcdbeb33ea4a11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ac0722fdade14d0ab5dcdbeb33ea4a11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ac0722fdade14d0ab5dcdbeb33ea4a11", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac0722fdade14d0ab5dcdbeb33ea4a11"}]}] Jul 13 21:13:30.860440 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant: tempest-VolumesNegativeTest-454002636 Jul 13 21:13:30.860440 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Id: ac0722fdade14d0ab5dcdbeb33ea4a11 Jul 13 21:13:30.860440 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Name: tempest-VolumesNegativeTest-454002636 Jul 13 21:13:30.860440 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User: tempest-VolumesNegativeTest-454002636-project Jul 13 21:13:30.860440 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Id: default Jul 13 21:13:30.860440 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Name: Default Jul 13 21:13:30.860440 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Id: c2c1e768cd7247de9895b492550af64a Jul 13 21:13:30.860440 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Name: tempest-VolumesNegativeTest-454002636-project Jul 13 21:13:30.860440 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Jul 13 21:13:30.860440 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-126575086", "metadata": {"Type": "work"}}} Jul 13 21:13:30.860440 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: method: Jul 13 21:13:30.860440 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 13 21:13:30.862015 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-126575086', 'metadata': {'Type': 'work'}}}} Jul 13 21:13:30.862015 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:13:30.862015 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:30.862015 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 13 21:13:30.862015 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 13 21:13:30.862015 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 13 21:13:30.862015 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise error Jul 13 21:13:30.862015 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 13 21:13:30.862015 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.862015 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 13 21:13:30.862015 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 13 21:13:30.862015 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.862015 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 13 21:13:30.862015 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi '' Jul 13 21:13:30.862015 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.862015 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:13:30.862015 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.862015 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:30.862015 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:13:30.862015 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:13:30.862015 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:13:30.862015 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:13:30.864922 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 13 21:13:30.864922 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 13 21:13:30.864922 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:13:30.864922 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:13:30.864922 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 13 21:13:30.864922 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 13 21:13:30.864922 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 13 21:13:30.864922 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 13 21:13:30.864922 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 13 21:13:30.864922 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 13 21:13:30.864922 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 13 21:13:30.864922 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.864922 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:13:30.864922 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.864922 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:30.864922 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:13:30.864922 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:13:30.864922 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 13 21:13:30.864922 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 13 21:13:30.866832 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 13 21:13:30.866832 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.866832 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-37bab1f1-447e-407e-a585-40294af67173 tempest-VolumesNegativeTest-454002636 tempest-VolumesNegativeTest-454002636-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:13:30.866832 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-37bab1f1-447e-407e-a585-40294af67173 tempest-VolumesNegativeTest-454002636 tempest-VolumesNegativeTest-454002636-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008232 Jul 13 21:13:30.866832 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 511/1005] 10.222.0.39 () {60 vars in 1155 bytes} [Wed Jul 13 21:13:30 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 13 21:13:30.869676 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-7801aec6-2cb3-4309-ae30-f63e767d3f09 tempest-VolumesNegativeTest-454002636 tempest-VolumesNegativeTest-454002636-project] Calling method '.version_select at 0x7f96e88b65e0>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:30.900192 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.wsgi [None req-7801aec6-2cb3-4309-ae30-f63e767d3f09 tempest-VolumesNegativeTest-454002636 tempest-VolumesNegativeTest-454002636-project] HTTP exception thrown: Volume tempest-invalid-1585126754 could not be found. Jul 13 21:13:30.902130 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-7801aec6-2cb3-4309-ae30-f63e767d3f09 tempest-VolumesNegativeTest-454002636 tempest-VolumesNegativeTest-454002636-project] Request method failure captured: Jul 13 21:13:30.902130 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1585126754 HTTP/1.1 Jul 13 21:13:30.902130 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept: application/json Jul 13 21:13:30.902130 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept-Encoding: identity Jul 13 21:13:30.902130 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Connection: close Jul 13 21:13:30.902130 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Length: 0 Jul 13 21:13:30.902130 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Type: application/json Jul 13 21:13:30.902130 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Host: 10.222.0.39 Jul 13 21:13:30.902130 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Openstack-System-Scope: None Jul 13 21:13:30.902130 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: User-Agent: python-urllib3/1.26.9 Jul 13 21:13:30.902130 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Auth-Token: gAAAAABizzV69ON85XJkOWnHEyupeBuMAJKjOhRornnLndDvwc6u4vLBDV2DeEVrpst4_1DsIobFTpJNl6jNmLlL9tXuqF9SgCV5a2a0jnSvBiIvCOC4t7ygPe7dUhTWD128rn9l6KtdEd1E5nVuvcvzg1xOngq53fanop69vj4Jg1YVnZgCcm8 Jul 13 21:13:30.902130 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Id: None Jul 13 21:13:30.902130 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Name: None Jul 13 21:13:30.902130 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Identity-Status: Confirmed Jul 13 21:13:30.902130 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Is-Admin-Project: True Jul 13 21:13:30.902130 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Id: default Jul 13 21:13:30.902130 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Name: Default Jul 13 21:13:30.902130 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Id: ac0722fdade14d0ab5dcdbeb33ea4a11 Jul 13 21:13:30.902130 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Name: tempest-VolumesNegativeTest-454002636 Jul 13 21:13:30.902130 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Role: member,reader Jul 13 21:13:30.902130 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Roles: member,reader Jul 13 21:13:30.903567 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac0722fdade14d0ab5dcdbeb33ea4a11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ac0722fdade14d0ab5dcdbeb33ea4a11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ac0722fdade14d0ab5dcdbeb33ea4a11", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac0722fdade14d0ab5dcdbeb33ea4a11"}]}] Jul 13 21:13:30.903567 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant: tempest-VolumesNegativeTest-454002636 Jul 13 21:13:30.903567 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Id: ac0722fdade14d0ab5dcdbeb33ea4a11 Jul 13 21:13:30.903567 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Name: tempest-VolumesNegativeTest-454002636 Jul 13 21:13:30.903567 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User: tempest-VolumesNegativeTest-454002636-project Jul 13 21:13:30.903567 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Id: default Jul 13 21:13:30.903567 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Name: Default Jul 13 21:13:30.903567 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Id: c2c1e768cd7247de9895b492550af64a Jul 13 21:13:30.903567 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Name: tempest-VolumesNegativeTest-454002636-project Jul 13 21:13:30.903567 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: method: Jul 13 21:13:30.903567 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: exception: Volume tempest-invalid-1585126754 could not be found. Jul 13 21:13:30.903567 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: action_args: {'id': 'tempest-invalid-1585126754'} Jul 13 21:13:30.903567 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:13:30.904353 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:30.904353 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 13 21:13:30.904353 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 13 21:13:30.904353 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 13 21:13:30.904353 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 13 21:13:30.904353 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 13 21:13:30.904353 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 13 21:13:30.904353 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 13 21:13:30.904353 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 13 21:13:30.904353 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 13 21:13:30.904353 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 13 21:13:30.904353 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 21:13:30.904353 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 21:13:30.904353 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 21:13:30.904353 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 21:13:30.904353 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1585126754 could not be found. (HTTP 404) (Request-ID: req-6bb4c9bc-eccd-4f2c-99e9-9c018c15cce8) Jul 13 21:13:30.904353 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.904353 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:13:30.904353 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.905522 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:30.905522 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 13 21:13:30.905522 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 13 21:13:30.905522 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 13 21:13:30.905522 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 13 21:13:30.905522 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 13 21:13:30.905522 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 13 21:13:30.905522 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 13 21:13:30.905522 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 13 21:13:30.905522 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 13 21:13:30.905522 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 13 21:13:30.905522 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 13 21:13:30.905522 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 13 21:13:30.905522 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 13 21:13:30.905522 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 13 21:13:30.905522 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 13 21:13:30.905522 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 13 21:13:30.905522 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 13 21:13:30.905522 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 13 21:13:30.907525 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 21:13:30.907525 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 21:13:30.907525 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 21:13:30.907525 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 21:13:30.907525 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1585126754 could not be found. Jul 13 21:13:30.907525 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.907525 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:13:30.907525 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.907525 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:30.907525 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:13:30.907525 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:13:30.907525 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:13:30.907525 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:13:30.907525 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 13 21:13:30.907525 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 13 21:13:30.907525 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:13:30.907525 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:13:30.907525 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 13 21:13:30.907525 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:13:30.907525 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1585126754 could not be found. Jul 13 21:13:30.909465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.909465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:13:30.909465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.909465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:30.909465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:13:30.909465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:13:30.909465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:13:30.909465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:13:30.909465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1585126754 could not be found. Jul 13 21:13:30.909465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.909465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-7801aec6-2cb3-4309-ae30-f63e767d3f09 tempest-VolumesNegativeTest-454002636 tempest-VolumesNegativeTest-454002636-project] Returning 404 to user: Volume tempest-invalid-1585126754 could not be found. {{(pid=118445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:13:30.909465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-7801aec6-2cb3-4309-ae30-f63e767d3f09 tempest-VolumesNegativeTest-454002636 tempest-VolumesNegativeTest-454002636-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1585126754" status: 404 len: 99 microversion: 2.1 time: 0.037975 Jul 13 21:13:30.909465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 512/1006] 10.222.0.39 () {58 vars in 1217 bytes} [Wed Jul 13 21:13:30 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1585126754 => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 13 21:13:30.915544 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-5be2b3d3-9eee-4388-b607-e47f5d2ef52b tempest-VolumesNegativeTest-454002636 tempest-VolumesNegativeTest-454002636-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004853 Jul 13 21:13:30.916137 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 513/1007] 10.222.0.39 () {58 vars in 1139 bytes} [Wed Jul 13 21:13:30 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 13 21:13:30.921562 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-eb44064e-a290-4f5e-8215-641c10e12649 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:30.926130 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-b1980c20-826f-4e37-ab98-223357245d01 tempest-VolumesNegativeTest-454002636 tempest-VolumesNegativeTest-454002636-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003758 Jul 13 21:13:30.926746 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 514/1008] 10.222.0.39 () {58 vars in 1136 bytes} [Wed Jul 13 21:13:30 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 13 21:13:30.929559 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-eb44064e-a290-4f5e-8215-641c10e12649 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:30.931026 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-eb44064e-a290-4f5e-8215-641c10e12649 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:30.932168 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-eb44064e-a290-4f5e-8215-641c10e12649 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1722 microversion: 2.20 time: 0.166488 Jul 13 21:13:30.932706 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 495/1009] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:30 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:13:30.934761 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-890dcab0-5d7f-40e6-9e70-05bcd9cc69a4 tempest-VolumesNegativeTest-454002636 tempest-VolumesNegativeTest-454002636-project] Calling method '.version_select at 0x7f96e88624c0>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:30.963185 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.wsgi [None req-890dcab0-5d7f-40e6-9e70-05bcd9cc69a4 tempest-VolumesNegativeTest-454002636 tempest-VolumesNegativeTest-454002636-project] HTTP exception thrown: Volume 0cfe5577-af6c-4b41-ada8-34c958648caf could not be found. Jul 13 21:13:30.965133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-890dcab0-5d7f-40e6-9e70-05bcd9cc69a4 tempest-VolumesNegativeTest-454002636 tempest-VolumesNegativeTest-454002636-project] Request method failure captured: Jul 13 21:13:30.965133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: request: DELETE /compute/v2.1/os-volumes/0cfe5577-af6c-4b41-ada8-34c958648caf HTTP/1.1 Jul 13 21:13:30.965133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept: application/json Jul 13 21:13:30.965133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept-Encoding: identity Jul 13 21:13:30.965133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Connection: close Jul 13 21:13:30.965133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Length: 0 Jul 13 21:13:30.965133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Type: application/json Jul 13 21:13:30.965133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Host: 10.222.0.39 Jul 13 21:13:30.965133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Openstack-System-Scope: None Jul 13 21:13:30.965133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: User-Agent: python-urllib3/1.26.9 Jul 13 21:13:30.965133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Auth-Token: gAAAAABizzV69ON85XJkOWnHEyupeBuMAJKjOhRornnLndDvwc6u4vLBDV2DeEVrpst4_1DsIobFTpJNl6jNmLlL9tXuqF9SgCV5a2a0jnSvBiIvCOC4t7ygPe7dUhTWD128rn9l6KtdEd1E5nVuvcvzg1xOngq53fanop69vj4Jg1YVnZgCcm8 Jul 13 21:13:30.965133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Id: None Jul 13 21:13:30.965133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Name: None Jul 13 21:13:30.965133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Identity-Status: Confirmed Jul 13 21:13:30.965133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Is-Admin-Project: True Jul 13 21:13:30.965133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Id: default Jul 13 21:13:30.965133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Name: Default Jul 13 21:13:30.965133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Id: ac0722fdade14d0ab5dcdbeb33ea4a11 Jul 13 21:13:30.965133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Name: tempest-VolumesNegativeTest-454002636 Jul 13 21:13:30.965133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Role: member,reader Jul 13 21:13:30.965133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Roles: member,reader Jul 13 21:13:30.966770 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac0722fdade14d0ab5dcdbeb33ea4a11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ac0722fdade14d0ab5dcdbeb33ea4a11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ac0722fdade14d0ab5dcdbeb33ea4a11", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac0722fdade14d0ab5dcdbeb33ea4a11"}]}] Jul 13 21:13:30.966770 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant: tempest-VolumesNegativeTest-454002636 Jul 13 21:13:30.966770 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Id: ac0722fdade14d0ab5dcdbeb33ea4a11 Jul 13 21:13:30.966770 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Name: tempest-VolumesNegativeTest-454002636 Jul 13 21:13:30.966770 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User: tempest-VolumesNegativeTest-454002636-project Jul 13 21:13:30.966770 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Id: default Jul 13 21:13:30.966770 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Name: Default Jul 13 21:13:30.966770 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Id: c2c1e768cd7247de9895b492550af64a Jul 13 21:13:30.966770 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Name: tempest-VolumesNegativeTest-454002636-project Jul 13 21:13:30.966770 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: method: Jul 13 21:13:30.966770 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: exception: Volume 0cfe5577-af6c-4b41-ada8-34c958648caf could not be found. Jul 13 21:13:30.966770 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: action_args: {'id': '0cfe5577-af6c-4b41-ada8-34c958648caf'} Jul 13 21:13:30.966770 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:13:30.967731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:30.967731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 13 21:13:30.967731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 13 21:13:30.967731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 13 21:13:30.967731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 13 21:13:30.967731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 13 21:13:30.967731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 13 21:13:30.967731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 13 21:13:30.967731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 13 21:13:30.967731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 13 21:13:30.967731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 13 21:13:30.967731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 21:13:30.967731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 21:13:30.967731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 21:13:30.967731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 21:13:30.967731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0cfe5577-af6c-4b41-ada8-34c958648caf could not be found. (HTTP 404) (Request-ID: req-3a40f64e-d716-41b7-ab77-fcccad961cae) Jul 13 21:13:30.967731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.967731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:13:30.967731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.969075 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:30.969075 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 13 21:13:30.969075 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 13 21:13:30.969075 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 13 21:13:30.969075 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 13 21:13:30.969075 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 13 21:13:30.969075 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 13 21:13:30.969075 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 13 21:13:30.969075 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 13 21:13:30.969075 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 13 21:13:30.969075 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 13 21:13:30.969075 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 13 21:13:30.969075 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 13 21:13:30.969075 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 13 21:13:30.969075 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 13 21:13:30.969075 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 13 21:13:30.969075 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 13 21:13:30.969075 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 13 21:13:30.969075 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 13 21:13:30.970578 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 21:13:30.970578 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 21:13:30.970578 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 21:13:30.970578 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 21:13:30.970578 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0cfe5577-af6c-4b41-ada8-34c958648caf could not be found. Jul 13 21:13:30.970578 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.970578 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:13:30.970578 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.970578 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:30.970578 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:13:30.970578 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:13:30.970578 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:13:30.970578 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:13:30.970578 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 13 21:13:30.970578 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 13 21:13:30.970578 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:13:30.970578 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:13:30.970578 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 13 21:13:30.970578 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:13:30.971930 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0cfe5577-af6c-4b41-ada8-34c958648caf could not be found. Jul 13 21:13:30.971930 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.971930 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:13:30.971930 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.971930 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:30.971930 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:13:30.971930 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:13:30.971930 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:13:30.971930 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:13:30.971930 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0cfe5577-af6c-4b41-ada8-34c958648caf could not be found. Jul 13 21:13:30.971930 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:13:30.971930 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-890dcab0-5d7f-40e6-9e70-05bcd9cc69a4 tempest-VolumesNegativeTest-454002636 tempest-VolumesNegativeTest-454002636-project] Returning 404 to user: Volume 0cfe5577-af6c-4b41-ada8-34c958648caf could not be found. {{(pid=118445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:13:30.971930 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-890dcab0-5d7f-40e6-9e70-05bcd9cc69a4 tempest-VolumesNegativeTest-454002636 tempest-VolumesNegativeTest-454002636-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/0cfe5577-af6c-4b41-ada8-34c958648caf" status: 404 len: 109 microversion: 2.1 time: 0.035133 Jul 13 21:13:30.971930 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 515/1010] 10.222.0.39 () {58 vars in 1247 bytes} [Wed Jul 13 21:13:30 2022] DELETE /compute/v2.1/os-volumes/0cfe5577-af6c-4b41-ada8-34c958648caf => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 13 21:13:30.977461 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-8a398016-9e75-4407-a9b1-5f9a20904e9b tempest-VolumesNegativeTest-454002636 tempest-VolumesNegativeTest-454002636-project] Calling method '.version_select at 0x7f96e88534c0>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:31.004140 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.wsgi [None req-8a398016-9e75-4407-a9b1-5f9a20904e9b tempest-VolumesNegativeTest-454002636 tempest-VolumesNegativeTest-454002636-project] HTTP exception thrown: Volume e793d8fd-8028-4e92-a5e3-3ec4047d0438 could not be found. Jul 13 21:13:31.006589 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-8a398016-9e75-4407-a9b1-5f9a20904e9b tempest-VolumesNegativeTest-454002636 tempest-VolumesNegativeTest-454002636-project] Request method failure captured: Jul 13 21:13:31.006589 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: request: GET /compute/v2.1/os-volumes/e793d8fd-8028-4e92-a5e3-3ec4047d0438 HTTP/1.1 Jul 13 21:13:31.006589 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept: application/json Jul 13 21:13:31.006589 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept-Encoding: identity Jul 13 21:13:31.006589 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Connection: close Jul 13 21:13:31.006589 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Length: 0 Jul 13 21:13:31.006589 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Type: application/json Jul 13 21:13:31.006589 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Host: 10.222.0.39 Jul 13 21:13:31.006589 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Openstack-System-Scope: None Jul 13 21:13:31.006589 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: User-Agent: python-urllib3/1.26.9 Jul 13 21:13:31.006589 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Auth-Token: gAAAAABizzV69ON85XJkOWnHEyupeBuMAJKjOhRornnLndDvwc6u4vLBDV2DeEVrpst4_1DsIobFTpJNl6jNmLlL9tXuqF9SgCV5a2a0jnSvBiIvCOC4t7ygPe7dUhTWD128rn9l6KtdEd1E5nVuvcvzg1xOngq53fanop69vj4Jg1YVnZgCcm8 Jul 13 21:13:31.006589 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Id: None Jul 13 21:13:31.006589 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Name: None Jul 13 21:13:31.006589 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Identity-Status: Confirmed Jul 13 21:13:31.006589 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Is-Admin-Project: True Jul 13 21:13:31.006589 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Id: default Jul 13 21:13:31.006589 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Name: Default Jul 13 21:13:31.006589 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Id: ac0722fdade14d0ab5dcdbeb33ea4a11 Jul 13 21:13:31.006589 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Name: tempest-VolumesNegativeTest-454002636 Jul 13 21:13:31.006589 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Role: member,reader Jul 13 21:13:31.006589 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Roles: member,reader Jul 13 21:13:31.009087 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac0722fdade14d0ab5dcdbeb33ea4a11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ac0722fdade14d0ab5dcdbeb33ea4a11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ac0722fdade14d0ab5dcdbeb33ea4a11", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac0722fdade14d0ab5dcdbeb33ea4a11"}]}] Jul 13 21:13:31.009087 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant: tempest-VolumesNegativeTest-454002636 Jul 13 21:13:31.009087 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Id: ac0722fdade14d0ab5dcdbeb33ea4a11 Jul 13 21:13:31.009087 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Name: tempest-VolumesNegativeTest-454002636 Jul 13 21:13:31.009087 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User: tempest-VolumesNegativeTest-454002636-project Jul 13 21:13:31.009087 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Id: default Jul 13 21:13:31.009087 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Name: Default Jul 13 21:13:31.009087 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Id: c2c1e768cd7247de9895b492550af64a Jul 13 21:13:31.009087 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Name: tempest-VolumesNegativeTest-454002636-project Jul 13 21:13:31.009087 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: method: Jul 13 21:13:31.009087 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: exception: Volume e793d8fd-8028-4e92-a5e3-3ec4047d0438 could not be found. Jul 13 21:13:31.009087 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: action_args: {'id': 'e793d8fd-8028-4e92-a5e3-3ec4047d0438'} Jul 13 21:13:31.009087 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:13:31.010000 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:31.010000 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 13 21:13:31.010000 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 13 21:13:31.010000 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 13 21:13:31.010000 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 13 21:13:31.010000 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 13 21:13:31.010000 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 13 21:13:31.010000 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 13 21:13:31.010000 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 13 21:13:31.010000 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 13 21:13:31.010000 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 13 21:13:31.010000 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 21:13:31.010000 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 21:13:31.010000 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 21:13:31.010000 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 21:13:31.010000 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e793d8fd-8028-4e92-a5e3-3ec4047d0438 could not be found. (HTTP 404) (Request-ID: req-1576ee58-4fc7-4307-904e-e08e676260eb) Jul 13 21:13:31.010000 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:13:31.010000 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:13:31.010000 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:13:31.011498 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:31.011498 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 13 21:13:31.011498 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 13 21:13:31.011498 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 13 21:13:31.011498 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 13 21:13:31.011498 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 13 21:13:31.011498 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 13 21:13:31.011498 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 13 21:13:31.011498 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 13 21:13:31.011498 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 13 21:13:31.011498 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 13 21:13:31.011498 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 13 21:13:31.011498 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 13 21:13:31.011498 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 13 21:13:31.011498 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 13 21:13:31.011498 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 13 21:13:31.011498 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 13 21:13:31.011498 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 13 21:13:31.011498 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 13 21:13:31.012954 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 21:13:31.012954 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 21:13:31.012954 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 21:13:31.012954 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 21:13:31.012954 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e793d8fd-8028-4e92-a5e3-3ec4047d0438 could not be found. Jul 13 21:13:31.012954 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:13:31.012954 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:13:31.012954 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:13:31.012954 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:31.012954 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:13:31.012954 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:13:31.012954 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:13:31.012954 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:13:31.012954 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 13 21:13:31.012954 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 13 21:13:31.012954 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:13:31.012954 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:13:31.012954 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 13 21:13:31.012954 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:13:31.014296 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e793d8fd-8028-4e92-a5e3-3ec4047d0438 could not be found. Jul 13 21:13:31.014296 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:13:31.014296 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:13:31.014296 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:13:31.014296 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:13:31.014296 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:13:31.014296 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:13:31.014296 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:13:31.014296 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:13:31.014296 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e793d8fd-8028-4e92-a5e3-3ec4047d0438 could not be found. Jul 13 21:13:31.014296 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:13:31.015067 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-bffed515-c1ab-4820-be3a-2a06e4c3d089 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:31.015190 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-8a398016-9e75-4407-a9b1-5f9a20904e9b tempest-VolumesNegativeTest-454002636 tempest-VolumesNegativeTest-454002636-project] Returning 404 to user: Volume e793d8fd-8028-4e92-a5e3-3ec4047d0438 could not be found. {{(pid=118444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:13:31.015282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-bffed515-c1ab-4820-be3a-2a06e4c3d089 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 22968c28-4691-4e3d-a9e9-dbc923b5fa93] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:31.015369 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-8a398016-9e75-4407-a9b1-5f9a20904e9b tempest-VolumesNegativeTest-454002636 tempest-VolumesNegativeTest-454002636-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/e793d8fd-8028-4e92-a5e3-3ec4047d0438" status: 404 len: 109 microversion: 2.1 time: 0.036606 Jul 13 21:13:31.015369 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 496/1011] 10.222.0.39 () {58 vars in 1244 bytes} [Wed Jul 13 21:13:30 2022] GET /compute/v2.1/os-volumes/e793d8fd-8028-4e92-a5e3-3ec4047d0438 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:13:31.020554 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bffed515-c1ab-4820-be3a-2a06e4c3d089 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:31.021002 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bffed515-c1ab-4820-be3a-2a06e4c3d089 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:31.021767 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bffed515-c1ab-4820-be3a-2a06e4c3d089 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:31.022192 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bffed515-c1ab-4820-be3a-2a06e4c3d089 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:31.027180 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:13:31.163397 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-bffed515-c1ab-4820-be3a-2a06e4c3d089 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:31.172051 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-bffed515-c1ab-4820-be3a-2a06e4c3d089 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93" status: 200 len: 1367 microversion: 2.1 time: 0.168323 Jul 13 21:13:31.172563 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 516/1012] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:31 2022] GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:13:31.950646 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-607a853e-0ac9-4bab-9b7a-a1f2631d83ac tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:31.951254 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-607a853e-0ac9-4bab-9b7a-a1f2631d83ac tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:31.960731 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-607a853e-0ac9-4bab-9b7a-a1f2631d83ac tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:31.961125 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-607a853e-0ac9-4bab-9b7a-a1f2631d83ac tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:31.961891 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-607a853e-0ac9-4bab-9b7a-a1f2631d83ac tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:31.962327 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-607a853e-0ac9-4bab-9b7a-a1f2631d83ac tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:32.157732 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-607a853e-0ac9-4bab-9b7a-a1f2631d83ac tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:32.166125 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-607a853e-0ac9-4bab-9b7a-a1f2631d83ac tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:32.167640 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-607a853e-0ac9-4bab-9b7a-a1f2631d83ac tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:32.168784 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-607a853e-0ac9-4bab-9b7a-a1f2631d83ac tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1722 microversion: 2.20 time: 0.223384 Jul 13 21:13:32.169621 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 497/1013] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:31 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:13:32.188763 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-3d6a330a-af71-4b7f-9d8f-21f9094fcd1e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:32.189366 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-3d6a330a-af71-4b7f-9d8f-21f9094fcd1e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 22968c28-4691-4e3d-a9e9-dbc923b5fa93] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:32.196165 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3d6a330a-af71-4b7f-9d8f-21f9094fcd1e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:32.196606 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3d6a330a-af71-4b7f-9d8f-21f9094fcd1e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:32.197355 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3d6a330a-af71-4b7f-9d8f-21f9094fcd1e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:32.197780 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3d6a330a-af71-4b7f-9d8f-21f9094fcd1e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:32.333147 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3d6a330a-af71-4b7f-9d8f-21f9094fcd1e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:32.341515 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-3d6a330a-af71-4b7f-9d8f-21f9094fcd1e tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93" status: 200 len: 1557 microversion: 2.1 time: 0.156806 Jul 13 21:13:32.342162 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 517/1014] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:13:32 2022] GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93 => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:13:32.358123 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-3f2948ff-6626-4f7c-8b1b-c1b0997c2007 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:32.358767 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-3f2948ff-6626-4f7c-8b1b-c1b0997c2007 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 22968c28-4691-4e3d-a9e9-dbc923b5fa93] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:32.364719 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3f2948ff-6626-4f7c-8b1b-c1b0997c2007 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:32.365237 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3f2948ff-6626-4f7c-8b1b-c1b0997c2007 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:32.366001 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3f2948ff-6626-4f7c-8b1b-c1b0997c2007 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:32.366438 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3f2948ff-6626-4f7c-8b1b-c1b0997c2007 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:32.455086 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-3f2948ff-6626-4f7c-8b1b-c1b0997c2007 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101155 Jul 13 21:13:32.455677 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 498/1015] 10.222.0.39 () {58 vars in 1274 bytes} [Wed Jul 13 21:13:32 2022] GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:13:33.187088 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-2891c3c0-595e-4502-b900-214f5236319f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:33.187691 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-2891c3c0-595e-4502-b900-214f5236319f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:33.194467 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2891c3c0-595e-4502-b900-214f5236319f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:33.195276 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2891c3c0-595e-4502-b900-214f5236319f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:33.195763 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2891c3c0-595e-4502-b900-214f5236319f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:33.196345 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2891c3c0-595e-4502-b900-214f5236319f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:33.438874 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-2891c3c0-595e-4502-b900-214f5236319f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:33.470185 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-2891c3c0-595e-4502-b900-214f5236319f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:33.473104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-2891c3c0-595e-4502-b900-214f5236319f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:33.477103 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-2891c3c0-595e-4502-b900-214f5236319f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1722 microversion: 2.20 time: 0.293084 Jul 13 21:13:33.485674 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 518/1016] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:33 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1722 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:13:33.505465 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-81c52b1a-aa0d-4eda-a956-ef6d9e073a77 req-84c23517-057a-44d2-b1d9-3f41e45565a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22968c28-4691-4e3d-a9e9-dbc923b5fa93", "tag": "821c0e73-63a8-4070-abbf-6531a9c1abc6"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:13:33.515218 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-81c52b1a-aa0d-4eda-a956-ef6d9e073a77 req-84c23517-057a-44d2-b1d9-3f41e45565a3 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:33.515828 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-81c52b1a-aa0d-4eda-a956-ef6d9e073a77 req-84c23517-057a-44d2-b1d9-3f41e45565a3 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:33.527926 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-81c52b1a-aa0d-4eda-a956-ef6d9e073a77 req-84c23517-057a-44d2-b1d9-3f41e45565a3 service nova] Creating event network-changed:821c0e73-63a8-4070-abbf-6531a9c1abc6 for instance 22968c28-4691-4e3d-a9e9-dbc923b5fa93 on hv-cinder-79987 Jul 13 21:13:33.533534 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-81c52b1a-aa0d-4eda-a956-ef6d9e073a77 req-84c23517-057a-44d2-b1d9-3f41e45565a3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033570 Jul 13 21:13:33.534417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 499/1017] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:13:34.496074 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c4958200-c1e5-41ce-b727-c1d8cc11e91a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:34.497619 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-c4958200-c1e5-41ce-b727-c1d8cc11e91a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:34.506437 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c4958200-c1e5-41ce-b727-c1d8cc11e91a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:34.506909 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c4958200-c1e5-41ce-b727-c1d8cc11e91a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:34.515979 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c4958200-c1e5-41ce-b727-c1d8cc11e91a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:34.516752 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c4958200-c1e5-41ce-b727-c1d8cc11e91a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:34.658183 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c4958200-c1e5-41ce-b727-c1d8cc11e91a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:34.668411 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c4958200-c1e5-41ce-b727-c1d8cc11e91a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:34.670281 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c4958200-c1e5-41ce-b727-c1d8cc11e91a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:34.671663 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-c4958200-c1e5-41ce-b727-c1d8cc11e91a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1722 microversion: 2.20 time: 0.180129 Jul 13 21:13:34.672727 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 519/1018] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:34 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:13:35.692111 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-56d260ce-f9ba-4aab-9005-377f12ad85a1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:35.692936 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-56d260ce-f9ba-4aab-9005-377f12ad85a1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:35.699721 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-56d260ce-f9ba-4aab-9005-377f12ad85a1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:35.700175 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-56d260ce-f9ba-4aab-9005-377f12ad85a1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:35.700938 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-56d260ce-f9ba-4aab-9005-377f12ad85a1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:35.701379 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-56d260ce-f9ba-4aab-9005-377f12ad85a1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:35.841375 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-56d260ce-f9ba-4aab-9005-377f12ad85a1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:35.850558 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-56d260ce-f9ba-4aab-9005-377f12ad85a1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:35.852601 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-56d260ce-f9ba-4aab-9005-377f12ad85a1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:35.853768 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-56d260ce-f9ba-4aab-9005-377f12ad85a1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1743 microversion: 2.20 time: 0.166505 Jul 13 21:13:35.854565 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 500/1019] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:35 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:13:36.872861 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-e2be929b-4a1b-4faa-bb56-bc53b154b7d0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:36.873557 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-e2be929b-4a1b-4faa-bb56-bc53b154b7d0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:36.880953 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e2be929b-4a1b-4faa-bb56-bc53b154b7d0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:36.881476 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e2be929b-4a1b-4faa-bb56-bc53b154b7d0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:36.885588 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e2be929b-4a1b-4faa-bb56-bc53b154b7d0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:36.886228 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e2be929b-4a1b-4faa-bb56-bc53b154b7d0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:37.020049 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-e2be929b-4a1b-4faa-bb56-bc53b154b7d0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:37.028570 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-e2be929b-4a1b-4faa-bb56-bc53b154b7d0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:37.030048 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-e2be929b-4a1b-4faa-bb56-bc53b154b7d0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:37.031220 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-e2be929b-4a1b-4faa-bb56-bc53b154b7d0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1743 microversion: 2.20 time: 0.162918 Jul 13 21:13:37.031806 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 520/1020] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:36 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:13:38.049296 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-1ce14ad5-1649-42bc-bf00-8d388482afb0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:38.050215 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-1ce14ad5-1649-42bc-bf00-8d388482afb0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:38.056735 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-845223bd-1b8f-4a2d-a31e-fcf0df23453d req-183f9b99-3a80-4f9c-b01d-e9ae4b4f2956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49b390c-173a-4b3b-b9ac-dc1afce64811", "name": "network-vif-plugged", "status": "completed", "tag": "6f0e0bf0-9555-4b8f-aeaf-d1acda127705"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:13:38.057841 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1ce14ad5-1649-42bc-bf00-8d388482afb0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:38.058472 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1ce14ad5-1649-42bc-bf00-8d388482afb0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:38.059463 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1ce14ad5-1649-42bc-bf00-8d388482afb0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:38.060059 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1ce14ad5-1649-42bc-bf00-8d388482afb0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:38.072066 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-845223bd-1b8f-4a2d-a31e-fcf0df23453d req-183f9b99-3a80-4f9c-b01d-e9ae4b4f2956 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:38.072518 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-845223bd-1b8f-4a2d-a31e-fcf0df23453d req-183f9b99-3a80-4f9c-b01d-e9ae4b4f2956 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:38.092745 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-845223bd-1b8f-4a2d-a31e-fcf0df23453d req-183f9b99-3a80-4f9c-b01d-e9ae4b4f2956 service nova] Creating event network-vif-plugged:6f0e0bf0-9555-4b8f-aeaf-d1acda127705 for instance d49b390c-173a-4b3b-b9ac-dc1afce64811 on hv-cinder-79987 Jul 13 21:13:38.098458 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-845223bd-1b8f-4a2d-a31e-fcf0df23453d req-183f9b99-3a80-4f9c-b01d-e9ae4b4f2956 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046743 Jul 13 21:13:38.100005 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 521/1021] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:13:38.207238 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-1ce14ad5-1649-42bc-bf00-8d388482afb0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:38.215698 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-1ce14ad5-1649-42bc-bf00-8d388482afb0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:38.217186 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-1ce14ad5-1649-42bc-bf00-8d388482afb0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:38.218336 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-1ce14ad5-1649-42bc-bf00-8d388482afb0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1743 microversion: 2.20 time: 0.172972 Jul 13 21:13:38.218918 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 501/1022] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:38 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1743 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:13:39.238026 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-731550be-5ad9-4fa4-a4c8-239d02d071c6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:39.238847 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-731550be-5ad9-4fa4-a4c8-239d02d071c6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:39.245661 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-731550be-5ad9-4fa4-a4c8-239d02d071c6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:39.246181 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-731550be-5ad9-4fa4-a4c8-239d02d071c6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:39.247053 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-731550be-5ad9-4fa4-a4c8-239d02d071c6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:39.247559 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-731550be-5ad9-4fa4-a4c8-239d02d071c6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:39.380872 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-731550be-5ad9-4fa4-a4c8-239d02d071c6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:39.389534 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-731550be-5ad9-4fa4-a4c8-239d02d071c6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:39.391055 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-731550be-5ad9-4fa4-a4c8-239d02d071c6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:39.392275 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-731550be-5ad9-4fa4-a4c8-239d02d071c6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1743 microversion: 2.20 time: 0.158887 Jul 13 21:13:39.392879 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 522/1023] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:39 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:13:40.411227 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-6b3176db-7eda-49c2-a76f-20df175987c5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:40.411896 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-6b3176db-7eda-49c2-a76f-20df175987c5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:40.418321 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6b3176db-7eda-49c2-a76f-20df175987c5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:40.418811 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6b3176db-7eda-49c2-a76f-20df175987c5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:40.419582 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6b3176db-7eda-49c2-a76f-20df175987c5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:40.420019 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6b3176db-7eda-49c2-a76f-20df175987c5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:40.594776 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-6b3176db-7eda-49c2-a76f-20df175987c5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:40.604184 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-6b3176db-7eda-49c2-a76f-20df175987c5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:40.605758 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-6b3176db-7eda-49c2-a76f-20df175987c5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:40.607219 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-6b3176db-7eda-49c2-a76f-20df175987c5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1743 microversion: 2.20 time: 0.199829 Jul 13 21:13:40.608212 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 502/1024] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:40 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1743 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:13:41.626660 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-8111a829-169b-444b-867a-939bcfe2612e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:41.627343 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8111a829-169b-444b-867a-939bcfe2612e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:41.635507 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8111a829-169b-444b-867a-939bcfe2612e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:41.636484 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8111a829-169b-444b-867a-939bcfe2612e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:41.637303 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8111a829-169b-444b-867a-939bcfe2612e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:41.637901 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8111a829-169b-444b-867a-939bcfe2612e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:41.852211 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8111a829-169b-444b-867a-939bcfe2612e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:41.870433 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8111a829-169b-444b-867a-939bcfe2612e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:41.874481 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8111a829-169b-444b-867a-939bcfe2612e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:41.877683 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-8111a829-169b-444b-867a-939bcfe2612e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1738 microversion: 2.20 time: 0.255823 Jul 13 21:13:41.879109 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 523/1025] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:41 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1738 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:13:42.898527 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-80fbf255-f14c-412f-86b7-ca93b364e147 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:42.901521 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-80fbf255-f14c-412f-86b7-ca93b364e147 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:42.910193 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-80fbf255-f14c-412f-86b7-ca93b364e147 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:42.910820 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-80fbf255-f14c-412f-86b7-ca93b364e147 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:42.911736 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-80fbf255-f14c-412f-86b7-ca93b364e147 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:42.912394 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-80fbf255-f14c-412f-86b7-ca93b364e147 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:43.112986 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-80fbf255-f14c-412f-86b7-ca93b364e147 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:43.146133 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-80fbf255-f14c-412f-86b7-ca93b364e147 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:43.149660 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-80fbf255-f14c-412f-86b7-ca93b364e147 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:43.152859 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-80fbf255-f14c-412f-86b7-ca93b364e147 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1738 microversion: 2.20 time: 0.259254 Jul 13 21:13:43.153977 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 503/1026] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:42 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1738 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:13:44.172543 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-e11c9c9a-5460-4384-8b62-cac1e3fd1a4a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:44.173502 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-e11c9c9a-5460-4384-8b62-cac1e3fd1a4a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:44.200963 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e11c9c9a-5460-4384-8b62-cac1e3fd1a4a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:44.201704 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e11c9c9a-5460-4384-8b62-cac1e3fd1a4a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:44.202689 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e11c9c9a-5460-4384-8b62-cac1e3fd1a4a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:44.203133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e11c9c9a-5460-4384-8b62-cac1e3fd1a4a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:44.383243 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-e11c9c9a-5460-4384-8b62-cac1e3fd1a4a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:44.392022 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-e11c9c9a-5460-4384-8b62-cac1e3fd1a4a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:44.394813 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-e11c9c9a-5460-4384-8b62-cac1e3fd1a4a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:44.396310 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-e11c9c9a-5460-4384-8b62-cac1e3fd1a4a tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1738 microversion: 2.20 time: 0.227729 Jul 13 21:13:44.397368 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 524/1027] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:44 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1738 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:13:45.415167 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-30cd717f-59f8-45e4-88ee-156984c2c1bb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:45.416096 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-30cd717f-59f8-45e4-88ee-156984c2c1bb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:45.422368 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-30cd717f-59f8-45e4-88ee-156984c2c1bb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:45.423061 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-30cd717f-59f8-45e4-88ee-156984c2c1bb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:45.423838 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-30cd717f-59f8-45e4-88ee-156984c2c1bb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:45.424431 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-30cd717f-59f8-45e4-88ee-156984c2c1bb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:45.592220 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-30cd717f-59f8-45e4-88ee-156984c2c1bb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:45.601322 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-30cd717f-59f8-45e4-88ee-156984c2c1bb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:45.603095 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-30cd717f-59f8-45e4-88ee-156984c2c1bb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:45.604243 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-30cd717f-59f8-45e4-88ee-156984c2c1bb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1738 microversion: 2.20 time: 0.193608 Jul 13 21:13:45.605376 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 504/1028] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:45 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1738 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:13:46.625008 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-3dc3dac2-9d1b-411a-bb44-a3eb6a07c83b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:46.626565 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-3dc3dac2-9d1b-411a-bb44-a3eb6a07c83b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:46.635053 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3dc3dac2-9d1b-411a-bb44-a3eb6a07c83b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:46.635718 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3dc3dac2-9d1b-411a-bb44-a3eb6a07c83b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:46.636851 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3dc3dac2-9d1b-411a-bb44-a3eb6a07c83b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:46.637286 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3dc3dac2-9d1b-411a-bb44-a3eb6a07c83b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:46.776985 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3dc3dac2-9d1b-411a-bb44-a3eb6a07c83b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:46.786304 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3dc3dac2-9d1b-411a-bb44-a3eb6a07c83b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:46.788651 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3dc3dac2-9d1b-411a-bb44-a3eb6a07c83b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:46.789809 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-3dc3dac2-9d1b-411a-bb44-a3eb6a07c83b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1738 microversion: 2.20 time: 0.169560 Jul 13 21:13:46.790653 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 525/1029] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:46 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:13:47.808985 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-92cffbfc-f220-4673-acc7-70b936f0c9f6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:47.809717 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-92cffbfc-f220-4673-acc7-70b936f0c9f6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:47.817350 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-92cffbfc-f220-4673-acc7-70b936f0c9f6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:47.817804 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-92cffbfc-f220-4673-acc7-70b936f0c9f6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:47.818570 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-92cffbfc-f220-4673-acc7-70b936f0c9f6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:47.819589 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-92cffbfc-f220-4673-acc7-70b936f0c9f6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:47.980129 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-92cffbfc-f220-4673-acc7-70b936f0c9f6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:47.991527 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-92cffbfc-f220-4673-acc7-70b936f0c9f6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:47.994757 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-92cffbfc-f220-4673-acc7-70b936f0c9f6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:47.996910 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-92cffbfc-f220-4673-acc7-70b936f0c9f6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1738 microversion: 2.20 time: 0.191226 Jul 13 21:13:47.997640 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 505/1030] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:47 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:13:49.016774 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-94e5cab9-701f-458f-83ed-7b03a4341af0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:49.018333 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-94e5cab9-701f-458f-83ed-7b03a4341af0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:49.026044 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-94e5cab9-701f-458f-83ed-7b03a4341af0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:49.027000 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-94e5cab9-701f-458f-83ed-7b03a4341af0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:49.028010 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-94e5cab9-701f-458f-83ed-7b03a4341af0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:49.028785 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-94e5cab9-701f-458f-83ed-7b03a4341af0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:49.185075 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-94e5cab9-701f-458f-83ed-7b03a4341af0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:49.193221 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-94e5cab9-701f-458f-83ed-7b03a4341af0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:49.195754 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-94e5cab9-701f-458f-83ed-7b03a4341af0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:49.196804 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-94e5cab9-701f-458f-83ed-7b03a4341af0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1738 microversion: 2.20 time: 0.184137 Jul 13 21:13:49.197361 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 526/1031] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:49 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:13:50.215537 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-7c1fa1ff-1b63-4c4e-9a20-a9754a18ed20 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:50.216852 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-7c1fa1ff-1b63-4c4e-9a20-a9754a18ed20 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:50.223934 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7c1fa1ff-1b63-4c4e-9a20-a9754a18ed20 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:50.225998 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7c1fa1ff-1b63-4c4e-9a20-a9754a18ed20 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:50.227053 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7c1fa1ff-1b63-4c4e-9a20-a9754a18ed20 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:50.227744 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7c1fa1ff-1b63-4c4e-9a20-a9754a18ed20 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:50.384076 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-7c1fa1ff-1b63-4c4e-9a20-a9754a18ed20 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:50.392195 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-7c1fa1ff-1b63-4c4e-9a20-a9754a18ed20 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:50.393722 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-7c1fa1ff-1b63-4c4e-9a20-a9754a18ed20 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:50.394930 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-7c1fa1ff-1b63-4c4e-9a20-a9754a18ed20 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1738 microversion: 2.20 time: 0.183575 Jul 13 21:13:50.395489 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 506/1032] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:50 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:13:51.414117 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-f7acbb8d-9b0d-44fe-804e-2772a6875cda tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:51.414748 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-f7acbb8d-9b0d-44fe-804e-2772a6875cda tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:51.421161 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f7acbb8d-9b0d-44fe-804e-2772a6875cda tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:51.421597 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f7acbb8d-9b0d-44fe-804e-2772a6875cda tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:51.422363 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f7acbb8d-9b0d-44fe-804e-2772a6875cda tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:51.422826 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f7acbb8d-9b0d-44fe-804e-2772a6875cda tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:51.551359 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-f7acbb8d-9b0d-44fe-804e-2772a6875cda tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:51.559388 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-f7acbb8d-9b0d-44fe-804e-2772a6875cda tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:51.560900 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-f7acbb8d-9b0d-44fe-804e-2772a6875cda tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:51.562046 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-f7acbb8d-9b0d-44fe-804e-2772a6875cda tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1720 microversion: 2.20 time: 0.152300 Jul 13 21:13:51.562601 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 527/1033] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:51 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:13:52.580255 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-f6d94899-68cd-4db0-b909-d5b84e07d34b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:52.580796 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-f6d94899-68cd-4db0-b909-d5b84e07d34b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:52.587019 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f6d94899-68cd-4db0-b909-d5b84e07d34b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:52.587473 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f6d94899-68cd-4db0-b909-d5b84e07d34b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:52.588269 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f6d94899-68cd-4db0-b909-d5b84e07d34b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:52.588721 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f6d94899-68cd-4db0-b909-d5b84e07d34b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:52.721762 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f6d94899-68cd-4db0-b909-d5b84e07d34b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:52.729951 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f6d94899-68cd-4db0-b909-d5b84e07d34b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:52.731462 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f6d94899-68cd-4db0-b909-d5b84e07d34b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:52.732595 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-f6d94899-68cd-4db0-b909-d5b84e07d34b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1720 microversion: 2.20 time: 0.156266 Jul 13 21:13:52.733208 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 507/1034] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:52 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:13:53.751498 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-6cda46ea-ded8-4a92-86c6-7bb19835fc42 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:53.752106 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-6cda46ea-ded8-4a92-86c6-7bb19835fc42 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:53.759507 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6cda46ea-ded8-4a92-86c6-7bb19835fc42 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:53.759956 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6cda46ea-ded8-4a92-86c6-7bb19835fc42 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:53.760749 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6cda46ea-ded8-4a92-86c6-7bb19835fc42 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:53.761179 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6cda46ea-ded8-4a92-86c6-7bb19835fc42 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:53.905818 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-6cda46ea-ded8-4a92-86c6-7bb19835fc42 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:53.913848 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-6cda46ea-ded8-4a92-86c6-7bb19835fc42 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:53.915362 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-6cda46ea-ded8-4a92-86c6-7bb19835fc42 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:53.916698 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-6cda46ea-ded8-4a92-86c6-7bb19835fc42 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1720 microversion: 2.20 time: 0.169055 Jul 13 21:13:53.917573 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 528/1035] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:53 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:13:53.971534 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-62063f93-b57c-4033-b0a1-6bfcfb9c56ad req-43292bf9-3268-4b13-9509-9503026a8f5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49b390c-173a-4b3b-b9ac-dc1afce64811", "name": "network-vif-unplugged", "status": "completed", "tag": "6f0e0bf0-9555-4b8f-aeaf-d1acda127705"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:13:53.980906 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-62063f93-b57c-4033-b0a1-6bfcfb9c56ad req-43292bf9-3268-4b13-9509-9503026a8f5e service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:53.981436 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-62063f93-b57c-4033-b0a1-6bfcfb9c56ad req-43292bf9-3268-4b13-9509-9503026a8f5e service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:53.994757 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-62063f93-b57c-4033-b0a1-6bfcfb9c56ad req-43292bf9-3268-4b13-9509-9503026a8f5e service nova] Creating event network-vif-unplugged:6f0e0bf0-9555-4b8f-aeaf-d1acda127705 for instance d49b390c-173a-4b3b-b9ac-dc1afce64811 on hv-cinder-79987 Jul 13 21:13:53.999818 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-62063f93-b57c-4033-b0a1-6bfcfb9c56ad req-43292bf9-3268-4b13-9509-9503026a8f5e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031899 Jul 13 21:13:54.000480 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 508/1036] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:13:54.934404 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-425a8da3-2e27-421f-846f-682ce098f6a0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:54.935031 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-425a8da3-2e27-421f-846f-682ce098f6a0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:54.941359 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-425a8da3-2e27-421f-846f-682ce098f6a0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:54.941869 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-425a8da3-2e27-421f-846f-682ce098f6a0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:54.946003 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-425a8da3-2e27-421f-846f-682ce098f6a0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:54.946003 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-425a8da3-2e27-421f-846f-682ce098f6a0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:55.077175 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-425a8da3-2e27-421f-846f-682ce098f6a0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:55.086115 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-425a8da3-2e27-421f-846f-682ce098f6a0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:55.087645 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-425a8da3-2e27-421f-846f-682ce098f6a0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:55.088780 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-425a8da3-2e27-421f-846f-682ce098f6a0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1663 microversion: 2.20 time: 0.158318 Jul 13 21:13:55.089341 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 529/1037] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:54 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:13:55.107046 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0191585c-cced-46f9-b31d-d86148481e9e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "687f8961-6561-412e-91ae-0c1ca179d731"}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:13:55.108173 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-0191585c-cced-46f9-b31d-d86148481e9e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:55.114347 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0191585c-cced-46f9-b31d-d86148481e9e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:55.114855 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0191585c-cced-46f9-b31d-d86148481e9e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:55.115668 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0191585c-cced-46f9-b31d-d86148481e9e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:55.116102 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0191585c-cced-46f9-b31d-d86148481e9e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:55.399014 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-0191585c-cced-46f9-b31d-d86148481e9e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "POST /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.296612 Jul 13 21:13:55.399696 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 509/1038] 10.222.0.39 () {62 vars in 1363 bytes} [Wed Jul 13 21:13:55 2022] POST /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811/os-volume_attachments => generated 188 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 21:13:55.510274 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-0205956d-f892-4ecb-9afd-fb29b516aa90 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:55.510805 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-0205956d-f892-4ecb-9afd-fb29b516aa90 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:55.516803 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0205956d-f892-4ecb-9afd-fb29b516aa90 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:55.517188 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0205956d-f892-4ecb-9afd-fb29b516aa90 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:55.517953 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0205956d-f892-4ecb-9afd-fb29b516aa90 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:55.518385 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0205956d-f892-4ecb-9afd-fb29b516aa90 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:55.756693 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-0205956d-f892-4ecb-9afd-fb29b516aa90 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811/os-volume_attachments/687f8961-6561-412e-91ae-0c1ca179d731" status: 202 len: 0 microversion: 2.20 time: 0.251193 Jul 13 21:13:55.757275 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 530/1039] 10.222.0.39 () {60 vars in 1456 bytes} [Wed Jul 13 21:13:55 2022] DELETE /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811/os-volume_attachments/687f8961-6561-412e-91ae-0c1ca179d731 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 13 21:13:55.817097 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-c866f0ee-40b1-4cf2-8dac-ec4500645dc6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:13:55.817685 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-c866f0ee-40b1-4cf2-8dac-ec4500645dc6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:55.824372 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c866f0ee-40b1-4cf2-8dac-ec4500645dc6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:55.824813 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c866f0ee-40b1-4cf2-8dac-ec4500645dc6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:55.825591 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c866f0ee-40b1-4cf2-8dac-ec4500645dc6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:55.826026 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c866f0ee-40b1-4cf2-8dac-ec4500645dc6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:55.844037 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:13:55.917556 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-c866f0ee-40b1-4cf2-8dac-ec4500645dc6 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "POST /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811/action" status: 202 len: 0 microversion: 2.20 time: 0.104327 Jul 13 21:13:55.918444 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 510/1040] 10.222.0.39 () {62 vars in 1318 bytes} [Wed Jul 13 21:13:55 2022] POST /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 13 21:13:55.926312 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-b9aefc89-b056-4361-9fba-bb02a58ec2f3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:55.927035 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-b9aefc89-b056-4361-9fba-bb02a58ec2f3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:55.933872 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b9aefc89-b056-4361-9fba-bb02a58ec2f3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:55.934395 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b9aefc89-b056-4361-9fba-bb02a58ec2f3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:55.935262 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b9aefc89-b056-4361-9fba-bb02a58ec2f3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:55.935778 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b9aefc89-b056-4361-9fba-bb02a58ec2f3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:55.941210 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:13:56.076172 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b9aefc89-b056-4361-9fba-bb02a58ec2f3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:56.084175 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b9aefc89-b056-4361-9fba-bb02a58ec2f3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:56.085701 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b9aefc89-b056-4361-9fba-bb02a58ec2f3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:56.086900 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-b9aefc89-b056-4361-9fba-bb02a58ec2f3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1671 microversion: 2.20 time: 0.164469 Jul 13 21:13:56.087466 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 531/1041] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:55 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:13:57.107026 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-d5760228-600d-4892-9158-074e1b169edb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:57.107783 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-d5760228-600d-4892-9158-074e1b169edb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:57.117400 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d5760228-600d-4892-9158-074e1b169edb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:57.118129 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d5760228-600d-4892-9158-074e1b169edb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:57.119161 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d5760228-600d-4892-9158-074e1b169edb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:57.119820 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d5760228-600d-4892-9158-074e1b169edb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:57.259384 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-d5760228-600d-4892-9158-074e1b169edb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:57.267876 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-d5760228-600d-4892-9158-074e1b169edb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:57.269531 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-d5760228-600d-4892-9158-074e1b169edb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:57.271092 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-d5760228-600d-4892-9158-074e1b169edb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1729 microversion: 2.20 time: 0.168876 Jul 13 21:13:57.271764 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 511/1042] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:57 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:13:58.289387 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-fe1c1874-48e1-45e1-9068-664290caa79c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:58.289987 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-fe1c1874-48e1-45e1-9068-664290caa79c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:58.296718 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-fe1c1874-48e1-45e1-9068-664290caa79c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:58.297282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-fe1c1874-48e1-45e1-9068-664290caa79c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:58.297925 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-fe1c1874-48e1-45e1-9068-664290caa79c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:58.298356 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-fe1c1874-48e1-45e1-9068-664290caa79c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:58.436864 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-fe1c1874-48e1-45e1-9068-664290caa79c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:58.445883 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-fe1c1874-48e1-45e1-9068-664290caa79c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:58.447462 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-fe1c1874-48e1-45e1-9068-664290caa79c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:58.448617 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-fe1c1874-48e1-45e1-9068-664290caa79c tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1729 microversion: 2.20 time: 0.163102 Jul 13 21:13:58.449918 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 532/1043] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:58 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:13:59.468684 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b16bfd50-854f-46d4-a0a5-3cca945c2e0d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:13:59.469599 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b16bfd50-854f-46d4-a0a5-3cca945c2e0d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:13:59.472829 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_api:SELECT=40 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:13:59.476861 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b16bfd50-854f-46d4-a0a5-3cca945c2e0d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:59.479161 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b16bfd50-854f-46d4-a0a5-3cca945c2e0d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:59.483586 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b16bfd50-854f-46d4-a0a5-3cca945c2e0d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:13:59.484506 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b16bfd50-854f-46d4-a0a5-3cca945c2e0d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:13:59.650016 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b16bfd50-854f-46d4-a0a5-3cca945c2e0d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:59.660335 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b16bfd50-854f-46d4-a0a5-3cca945c2e0d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:59.662213 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b16bfd50-854f-46d4-a0a5-3cca945c2e0d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:13:59.663984 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b16bfd50-854f-46d4-a0a5-3cca945c2e0d tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1729 microversion: 2.20 time: 0.200262 Jul 13 21:13:59.694880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 512/1044] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:13:59 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1729 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:14:00.683152 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-dbe04dc9-43f6-42cf-879d-80b458e90f16 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:00.683768 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-dbe04dc9-43f6-42cf-879d-80b458e90f16 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:00.686394 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_api:SELECT=40 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:14:00.692101 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-dbe04dc9-43f6-42cf-879d-80b458e90f16 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:00.693026 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-dbe04dc9-43f6-42cf-879d-80b458e90f16 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:00.694222 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-dbe04dc9-43f6-42cf-879d-80b458e90f16 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:00.703568 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-dbe04dc9-43f6-42cf-879d-80b458e90f16 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:00.866358 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-dbe04dc9-43f6-42cf-879d-80b458e90f16 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:00.875068 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-dbe04dc9-43f6-42cf-879d-80b458e90f16 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:00.876883 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-dbe04dc9-43f6-42cf-879d-80b458e90f16 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:00.878067 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-dbe04dc9-43f6-42cf-879d-80b458e90f16 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1729 microversion: 2.20 time: 0.199239 Jul 13 21:14:00.890285 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 533/1045] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:14:00 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1729 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:14:01.896815 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b20e2dc6-b571-4ef9-9767-dcb2c7c85a1f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:01.897415 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b20e2dc6-b571-4ef9-9767-dcb2c7c85a1f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:01.904011 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b20e2dc6-b571-4ef9-9767-dcb2c7c85a1f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:01.904459 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b20e2dc6-b571-4ef9-9767-dcb2c7c85a1f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:01.905228 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b20e2dc6-b571-4ef9-9767-dcb2c7c85a1f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:01.905667 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b20e2dc6-b571-4ef9-9767-dcb2c7c85a1f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:02.045728 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b20e2dc6-b571-4ef9-9767-dcb2c7c85a1f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:02.054806 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b20e2dc6-b571-4ef9-9767-dcb2c7c85a1f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:02.056571 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b20e2dc6-b571-4ef9-9767-dcb2c7c85a1f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:02.057882 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b20e2dc6-b571-4ef9-9767-dcb2c7c85a1f tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1729 microversion: 2.20 time: 0.165039 Jul 13 21:14:02.058668 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 513/1046] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:14:01 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:14:03.075951 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-8458429b-d27b-4089-9e1f-935b66bdded9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:03.076695 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8458429b-d27b-4089-9e1f-935b66bdded9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:03.083694 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8458429b-d27b-4089-9e1f-935b66bdded9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:03.084991 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8458429b-d27b-4089-9e1f-935b66bdded9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:03.085999 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8458429b-d27b-4089-9e1f-935b66bdded9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:03.086444 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8458429b-d27b-4089-9e1f-935b66bdded9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:03.231295 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8458429b-d27b-4089-9e1f-935b66bdded9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:03.239595 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8458429b-d27b-4089-9e1f-935b66bdded9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:03.241101 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8458429b-d27b-4089-9e1f-935b66bdded9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:03.242465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-8458429b-d27b-4089-9e1f-935b66bdded9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1729 microversion: 2.20 time: 0.170482 Jul 13 21:14:03.243062 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 534/1047] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:14:03 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:14:04.264147 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-56d03676-0b94-4be5-befd-d3968de7f874 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:04.265426 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-56d03676-0b94-4be5-befd-d3968de7f874 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:04.273535 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-56d03676-0b94-4be5-befd-d3968de7f874 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:04.274035 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-56d03676-0b94-4be5-befd-d3968de7f874 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:04.274840 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-56d03676-0b94-4be5-befd-d3968de7f874 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:04.275666 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-56d03676-0b94-4be5-befd-d3968de7f874 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:04.450582 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-56d03676-0b94-4be5-befd-d3968de7f874 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:04.467447 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-56d03676-0b94-4be5-befd-d3968de7f874 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:04.468985 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-56d03676-0b94-4be5-befd-d3968de7f874 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:04.471066 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-56d03676-0b94-4be5-befd-d3968de7f874 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1729 microversion: 2.20 time: 0.213808 Jul 13 21:14:04.472251 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 514/1048] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:14:04 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1729 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:14:05.491822 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-f9eef480-1631-4144-a735-5fa11a2abab5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:05.492424 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-f9eef480-1631-4144-a735-5fa11a2abab5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:05.499682 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f9eef480-1631-4144-a735-5fa11a2abab5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:05.500306 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f9eef480-1631-4144-a735-5fa11a2abab5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:05.501252 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f9eef480-1631-4144-a735-5fa11a2abab5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:05.501732 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f9eef480-1631-4144-a735-5fa11a2abab5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:05.680292 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-f9eef480-1631-4144-a735-5fa11a2abab5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:05.690564 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-f9eef480-1631-4144-a735-5fa11a2abab5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:05.692631 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-f9eef480-1631-4144-a735-5fa11a2abab5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:05.694588 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-f9eef480-1631-4144-a735-5fa11a2abab5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1729 microversion: 2.20 time: 0.206369 Jul 13 21:14:05.695253 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 535/1049] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:14:05 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:14:06.713262 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-2945f4c5-8757-47af-bfa4-2db20d579f39 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:06.713852 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-2945f4c5-8757-47af-bfa4-2db20d579f39 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:06.720464 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2945f4c5-8757-47af-bfa4-2db20d579f39 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:06.720910 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2945f4c5-8757-47af-bfa4-2db20d579f39 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:06.721676 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2945f4c5-8757-47af-bfa4-2db20d579f39 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:06.722108 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2945f4c5-8757-47af-bfa4-2db20d579f39 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:06.864952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-2945f4c5-8757-47af-bfa4-2db20d579f39 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:06.873980 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-2945f4c5-8757-47af-bfa4-2db20d579f39 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:06.875482 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-2945f4c5-8757-47af-bfa4-2db20d579f39 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:06.876669 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-2945f4c5-8757-47af-bfa4-2db20d579f39 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1729 microversion: 2.20 time: 0.167326 Jul 13 21:14:06.877522 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 515/1050] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:14:06 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:14:07.896349 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-8a897454-ffc7-454e-b1e7-122612972024 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:07.897122 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8a897454-ffc7-454e-b1e7-122612972024 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:07.905194 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8a897454-ffc7-454e-b1e7-122612972024 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:07.905765 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8a897454-ffc7-454e-b1e7-122612972024 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:07.906652 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8a897454-ffc7-454e-b1e7-122612972024 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:07.907445 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8a897454-ffc7-454e-b1e7-122612972024 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:08.047029 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8a897454-ffc7-454e-b1e7-122612972024 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:08.064186 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8a897454-ffc7-454e-b1e7-122612972024 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:08.065666 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8a897454-ffc7-454e-b1e7-122612972024 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:08.066851 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-8a897454-ffc7-454e-b1e7-122612972024 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1729 microversion: 2.20 time: 0.174535 Jul 13 21:14:08.067408 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 536/1051] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:14:07 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:14:09.085966 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b698ed33-e1f0-410f-a892-25feb11387e1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:09.087184 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b698ed33-e1f0-410f-a892-25feb11387e1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:09.093762 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b698ed33-e1f0-410f-a892-25feb11387e1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:09.094233 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b698ed33-e1f0-410f-a892-25feb11387e1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:09.095026 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b698ed33-e1f0-410f-a892-25feb11387e1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:09.095458 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b698ed33-e1f0-410f-a892-25feb11387e1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:09.227954 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b698ed33-e1f0-410f-a892-25feb11387e1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:09.235715 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b698ed33-e1f0-410f-a892-25feb11387e1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:09.237185 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b698ed33-e1f0-410f-a892-25feb11387e1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:09.238315 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b698ed33-e1f0-410f-a892-25feb11387e1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1729 microversion: 2.20 time: 0.156480 Jul 13 21:14:09.238906 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 516/1052] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:14:09 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 21:14:10.256298 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-03138729-a030-4e09-93c0-c919380aa6e3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:10.257000 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-03138729-a030-4e09-93c0-c919380aa6e3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:10.264709 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-03138729-a030-4e09-93c0-c919380aa6e3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:10.265158 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-03138729-a030-4e09-93c0-c919380aa6e3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:10.265939 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-03138729-a030-4e09-93c0-c919380aa6e3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:10.266380 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-03138729-a030-4e09-93c0-c919380aa6e3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:10.398043 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-03138729-a030-4e09-93c0-c919380aa6e3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:10.406502 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-03138729-a030-4e09-93c0-c919380aa6e3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:10.408018 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-03138729-a030-4e09-93c0-c919380aa6e3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:10.409171 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-03138729-a030-4e09-93c0-c919380aa6e3 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1729 microversion: 2.20 time: 0.156915 Jul 13 21:14:10.409726 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 537/1053] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:14:10 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:14:11.427374 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-9823fa9b-bc13-4307-9b8b-5c58408e345b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:11.428055 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-9823fa9b-bc13-4307-9b8b-5c58408e345b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:11.435717 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9823fa9b-bc13-4307-9b8b-5c58408e345b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:11.436173 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9823fa9b-bc13-4307-9b8b-5c58408e345b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:11.436940 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9823fa9b-bc13-4307-9b8b-5c58408e345b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:11.437377 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9823fa9b-bc13-4307-9b8b-5c58408e345b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:11.565850 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-9823fa9b-bc13-4307-9b8b-5c58408e345b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:11.573827 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-9823fa9b-bc13-4307-9b8b-5c58408e345b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:11.575349 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-9823fa9b-bc13-4307-9b8b-5c58408e345b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:11.576492 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-9823fa9b-bc13-4307-9b8b-5c58408e345b tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1729 microversion: 2.20 time: 0.153227 Jul 13 21:14:11.577058 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 517/1054] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:14:11 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:14:12.594186 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-3869df1d-259f-4750-a63e-3a84ae4fd9c9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:12.594764 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-3869df1d-259f-4750-a63e-3a84ae4fd9c9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:12.601134 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3869df1d-259f-4750-a63e-3a84ae4fd9c9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:12.601573 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3869df1d-259f-4750-a63e-3a84ae4fd9c9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:12.602319 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3869df1d-259f-4750-a63e-3a84ae4fd9c9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:12.602777 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3869df1d-259f-4750-a63e-3a84ae4fd9c9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:12.733270 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3869df1d-259f-4750-a63e-3a84ae4fd9c9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:12.741118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3869df1d-259f-4750-a63e-3a84ae4fd9c9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:12.742598 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3869df1d-259f-4750-a63e-3a84ae4fd9c9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:12.743793 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-3869df1d-259f-4750-a63e-3a84ae4fd9c9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1729 microversion: 2.20 time: 0.153543 Jul 13 21:14:12.744339 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 538/1055] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:14:12 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:14:13.179709 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b1f7a58d-ca1b-4354-8ea9-13152bef9bc1 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:13.180271 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b1f7a58d-ca1b-4354-8ea9-13152bef9bc1 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:13.186909 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b1f7a58d-ca1b-4354-8ea9-13152bef9bc1 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:13.187297 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b1f7a58d-ca1b-4354-8ea9-13152bef9bc1 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:13.188076 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b1f7a58d-ca1b-4354-8ea9-13152bef9bc1 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:13.188512 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b1f7a58d-ca1b-4354-8ea9-13152bef9bc1 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:13.210851 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b1f7a58d-ca1b-4354-8ea9-13152bef9bc1 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147/ips" status: 200 len: 147 microversion: 2.1 time: 0.034966 Jul 13 21:14:13.211419 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 518/1056] 10.222.0.39 () {58 vars in 1247 bytes} [Wed Jul 13 21:14:13 2022] GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147/ips => generated 147 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:14:13.763366 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-db5455f9-9852-4ef9-82bc-84177ec0df08 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:13.763903 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-db5455f9-9852-4ef9-82bc-84177ec0df08 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:13.770377 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-db5455f9-9852-4ef9-82bc-84177ec0df08 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:13.770847 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-db5455f9-9852-4ef9-82bc-84177ec0df08 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:13.771602 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-db5455f9-9852-4ef9-82bc-84177ec0df08 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:13.772032 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-db5455f9-9852-4ef9-82bc-84177ec0df08 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:13.907984 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-db5455f9-9852-4ef9-82bc-84177ec0df08 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:13.915800 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-db5455f9-9852-4ef9-82bc-84177ec0df08 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:13.917288 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-db5455f9-9852-4ef9-82bc-84177ec0df08 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:13.918427 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-db5455f9-9852-4ef9-82bc-84177ec0df08 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1729 microversion: 2.20 time: 0.159580 Jul 13 21:14:13.919006 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 539/1057] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:14:13 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:14:14.937624 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0b5fa996-3676-4053-9830-c728055cccc9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:14.938210 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-0b5fa996-3676-4053-9830-c728055cccc9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:14.944992 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0b5fa996-3676-4053-9830-c728055cccc9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:14.945438 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0b5fa996-3676-4053-9830-c728055cccc9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:14.946229 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0b5fa996-3676-4053-9830-c728055cccc9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:14.946685 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0b5fa996-3676-4053-9830-c728055cccc9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:15.076457 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-0b5fa996-3676-4053-9830-c728055cccc9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:15.084470 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-0b5fa996-3676-4053-9830-c728055cccc9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:15.085953 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-0b5fa996-3676-4053-9830-c728055cccc9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:15.087125 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-0b5fa996-3676-4053-9830-c728055cccc9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1729 microversion: 2.20 time: 0.153937 Jul 13 21:14:15.087663 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 519/1058] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:14:14 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:14:15.570318 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-498e18ff-99de-404d-a6f1-3e57d6e9e536 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7dfc08ea-bb86-4796-905e-b625426bbf69"}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:14:15.571710 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-498e18ff-99de-404d-a6f1-3e57d6e9e536 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:15.578447 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-498e18ff-99de-404d-a6f1-3e57d6e9e536 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:15.578930 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-498e18ff-99de-404d-a6f1-3e57d6e9e536 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:15.579704 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-498e18ff-99de-404d-a6f1-3e57d6e9e536 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:15.580143 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-498e18ff-99de-404d-a6f1-3e57d6e9e536 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:15.839583 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-498e18ff-99de-404d-a6f1-3e57d6e9e536 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "POST /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273049 Jul 13 21:14:15.840193 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 540/1059] 10.222.0.39 () {60 vars in 1322 bytes} [Wed Jul 13 21:14:15 2022] POST /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:14:16.106955 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-f56c1d3b-314e-4e3a-a200-2f8e8a28eca5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:16.107626 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-f56c1d3b-314e-4e3a-a200-2f8e8a28eca5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:16.116253 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f56c1d3b-314e-4e3a-a200-2f8e8a28eca5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:16.116730 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f56c1d3b-314e-4e3a-a200-2f8e8a28eca5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:16.117531 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f56c1d3b-314e-4e3a-a200-2f8e8a28eca5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:16.118049 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f56c1d3b-314e-4e3a-a200-2f8e8a28eca5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:16.247015 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f56c1d3b-314e-4e3a-a200-2f8e8a28eca5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:16.254958 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f56c1d3b-314e-4e3a-a200-2f8e8a28eca5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:16.256496 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f56c1d3b-314e-4e3a-a200-2f8e8a28eca5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:16.257600 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-f56c1d3b-314e-4e3a-a200-2f8e8a28eca5 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1729 microversion: 2.20 time: 0.155544 Jul 13 21:14:16.258417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 520/1060] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:14:16 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:14:17.277954 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c6cdf0f1-005b-4182-85ad-ceb7cd385dc1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:17.278722 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-c6cdf0f1-005b-4182-85ad-ceb7cd385dc1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:17.285003 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c6cdf0f1-005b-4182-85ad-ceb7cd385dc1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:17.285452 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c6cdf0f1-005b-4182-85ad-ceb7cd385dc1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:17.286218 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c6cdf0f1-005b-4182-85ad-ceb7cd385dc1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:17.286678 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c6cdf0f1-005b-4182-85ad-ceb7cd385dc1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:17.415566 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c6cdf0f1-005b-4182-85ad-ceb7cd385dc1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:17.424092 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c6cdf0f1-005b-4182-85ad-ceb7cd385dc1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:17.425599 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c6cdf0f1-005b-4182-85ad-ceb7cd385dc1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:17.426868 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-c6cdf0f1-005b-4182-85ad-ceb7cd385dc1 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1729 microversion: 2.20 time: 0.153884 Jul 13 21:14:17.427432 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 541/1061] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:14:17 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:14:18.097059 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-51315f6b-e7c9-49f8-b14a-ba7c41e8bbd6 req-52bf8a13-8738-4610-bb95-bdcbdc64bb38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49b390c-173a-4b3b-b9ac-dc1afce64811", "name": "network-vif-plugged", "status": "completed", "tag": "6f0e0bf0-9555-4b8f-aeaf-d1acda127705"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:14:18.107555 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-51315f6b-e7c9-49f8-b14a-ba7c41e8bbd6 req-52bf8a13-8738-4610-bb95-bdcbdc64bb38 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:18.108041 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-51315f6b-e7c9-49f8-b14a-ba7c41e8bbd6 req-52bf8a13-8738-4610-bb95-bdcbdc64bb38 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:18.119540 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-51315f6b-e7c9-49f8-b14a-ba7c41e8bbd6 req-52bf8a13-8738-4610-bb95-bdcbdc64bb38 service nova] Creating event network-vif-plugged:6f0e0bf0-9555-4b8f-aeaf-d1acda127705 for instance d49b390c-173a-4b3b-b9ac-dc1afce64811 on hv-cinder-79987 Jul 13 21:14:18.124639 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-51315f6b-e7c9-49f8-b14a-ba7c41e8bbd6 req-52bf8a13-8738-4610-bb95-bdcbdc64bb38 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031293 Jul 13 21:14:18.125659 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 521/1062] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:14:18.445479 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-8af367ac-3497-424a-9835-ea69b315bfbe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:18.446096 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8af367ac-3497-424a-9835-ea69b315bfbe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:18.453211 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8af367ac-3497-424a-9835-ea69b315bfbe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:18.453604 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8af367ac-3497-424a-9835-ea69b315bfbe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:18.454371 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8af367ac-3497-424a-9835-ea69b315bfbe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:18.454839 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8af367ac-3497-424a-9835-ea69b315bfbe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:18.582504 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8af367ac-3497-424a-9835-ea69b315bfbe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:18.590374 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8af367ac-3497-424a-9835-ea69b315bfbe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:18.591906 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8af367ac-3497-424a-9835-ea69b315bfbe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:18.593056 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-8af367ac-3497-424a-9835-ea69b315bfbe tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1729 microversion: 2.20 time: 0.151586 Jul 13 21:14:18.593611 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 542/1063] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:14:18 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:14:19.612034 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b5a54b70-75e3-4b8f-9fae-81fe7d65ade7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:19.612758 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b5a54b70-75e3-4b8f-9fae-81fe7d65ade7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:19.619433 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b5a54b70-75e3-4b8f-9fae-81fe7d65ade7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:19.619881 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b5a54b70-75e3-4b8f-9fae-81fe7d65ade7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:19.620630 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b5a54b70-75e3-4b8f-9fae-81fe7d65ade7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:19.621058 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b5a54b70-75e3-4b8f-9fae-81fe7d65ade7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:19.745975 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b5a54b70-75e3-4b8f-9fae-81fe7d65ade7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:19.754883 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b5a54b70-75e3-4b8f-9fae-81fe7d65ade7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:19.756362 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b5a54b70-75e3-4b8f-9fae-81fe7d65ade7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:19.757496 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b5a54b70-75e3-4b8f-9fae-81fe7d65ade7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1729 microversion: 2.20 time: 0.149696 Jul 13 21:14:19.758311 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 522/1064] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:14:19 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:14:20.776080 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ddf812d6-f1c7-4b47-8150-6bcb34039173 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:20.776681 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ddf812d6-f1c7-4b47-8150-6bcb34039173 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:20.783766 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ddf812d6-f1c7-4b47-8150-6bcb34039173 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:20.784358 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ddf812d6-f1c7-4b47-8150-6bcb34039173 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:20.785151 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ddf812d6-f1c7-4b47-8150-6bcb34039173 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:20.785653 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ddf812d6-f1c7-4b47-8150-6bcb34039173 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:20.917890 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ddf812d6-f1c7-4b47-8150-6bcb34039173 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:20.927226 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ddf812d6-f1c7-4b47-8150-6bcb34039173 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:20.928723 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ddf812d6-f1c7-4b47-8150-6bcb34039173 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:20.929881 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ddf812d6-f1c7-4b47-8150-6bcb34039173 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1729 microversion: 2.20 time: 0.157814 Jul 13 21:14:20.930522 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 543/1065] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:14:20 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:14:21.948638 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-d90e29f1-ac3c-4004-9fb4-f2d6b9dbd644 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:21.949244 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-d90e29f1-ac3c-4004-9fb4-f2d6b9dbd644 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:21.956263 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d90e29f1-ac3c-4004-9fb4-f2d6b9dbd644 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:21.956721 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d90e29f1-ac3c-4004-9fb4-f2d6b9dbd644 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:21.957486 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d90e29f1-ac3c-4004-9fb4-f2d6b9dbd644 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:21.957932 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d90e29f1-ac3c-4004-9fb4-f2d6b9dbd644 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:22.089495 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-d90e29f1-ac3c-4004-9fb4-f2d6b9dbd644 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:22.097480 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-d90e29f1-ac3c-4004-9fb4-f2d6b9dbd644 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:22.099008 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-d90e29f1-ac3c-4004-9fb4-f2d6b9dbd644 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:22.100166 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-d90e29f1-ac3c-4004-9fb4-f2d6b9dbd644 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1716 microversion: 2.20 time: 0.155423 Jul 13 21:14:22.100728 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 523/1066] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:14:21 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:14:23.329640 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-913e8758-f01c-4158-8dc1-fbe795776be7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:23.330671 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-913e8758-f01c-4158-8dc1-fbe795776be7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:23.337051 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-913e8758-f01c-4158-8dc1-fbe795776be7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:23.337494 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-913e8758-f01c-4158-8dc1-fbe795776be7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:23.338251 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-913e8758-f01c-4158-8dc1-fbe795776be7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:23.338715 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-913e8758-f01c-4158-8dc1-fbe795776be7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:23.367137 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-913e8758-f01c-4158-8dc1-fbe795776be7 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042096 Jul 13 21:14:23.367621 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 544/1067] 10.222.0.39 () {58 vars in 1301 bytes} [Wed Jul 13 21:14:23 2022] GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:14:23.377375 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-2ea1ffe1-11d5-4c9f-a9f8-4f30adc76c74 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:23.377857 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-2ea1ffe1-11d5-4c9f-a9f8-4f30adc76c74 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:23.384537 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2ea1ffe1-11d5-4c9f-a9f8-4f30adc76c74 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:23.384981 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2ea1ffe1-11d5-4c9f-a9f8-4f30adc76c74 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:23.385729 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2ea1ffe1-11d5-4c9f-a9f8-4f30adc76c74 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:23.386158 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2ea1ffe1-11d5-4c9f-a9f8-4f30adc76c74 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:23.414405 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-2ea1ffe1-11d5-4c9f-a9f8-4f30adc76c74 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147/os-volume_attachments/7dfc08ea-bb86-4796-905e-b625426bbf69" status: 200 len: 194 microversion: 2.1 time: 0.040907 Jul 13 21:14:23.415130 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 524/1068] 10.222.0.39 () {58 vars in 1412 bytes} [Wed Jul 13 21:14:23 2022] GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147/os-volume_attachments/7dfc08ea-bb86-4796-905e-b625426bbf69 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:14:25.767907 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-33399681-97e5-425a-bcb0-02be22b618a1 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c3e9243-3ce2-4d3d-84d4-5a4208e803ed"}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:14:25.768954 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-33399681-97e5-425a-bcb0-02be22b618a1 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:25.775443 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-33399681-97e5-425a-bcb0-02be22b618a1 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:25.775883 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-33399681-97e5-425a-bcb0-02be22b618a1 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:25.776631 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-33399681-97e5-425a-bcb0-02be22b618a1 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:25.777064 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-33399681-97e5-425a-bcb0-02be22b618a1 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:25.931951 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:14:26.040944 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-33399681-97e5-425a-bcb0-02be22b618a1 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "POST /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276707 Jul 13 21:14:26.041487 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 545/1069] 10.222.0.39 () {60 vars in 1322 bytes} [Wed Jul 13 21:14:25 2022] POST /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:14:47.195964 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-fffc48d9-905a-4d0c-9d08-6d24078cb68b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:47.196880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-fffc48d9-905a-4d0c-9d08-6d24078cb68b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:47.199547 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_api:SELECT=25 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:14:47.200368 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:14:47.205784 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fffc48d9-905a-4d0c-9d08-6d24078cb68b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:47.206417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fffc48d9-905a-4d0c-9d08-6d24078cb68b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:47.207376 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fffc48d9-905a-4d0c-9d08-6d24078cb68b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:47.207815 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fffc48d9-905a-4d0c-9d08-6d24078cb68b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:47.238514 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-fffc48d9-905a-4d0c-9d08-6d24078cb68b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046362 Jul 13 21:14:47.239100 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 525/1070] 10.222.0.39 () {58 vars in 1301 bytes} [Wed Jul 13 21:14:47 2022] GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:14:47.386595 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_api:SELECT=25 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:14:47.387555 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=3,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:14:47.391570 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-1630ada6-b2c7-47da-a27b-323aaf98e630 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:47.392142 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-1630ada6-b2c7-47da-a27b-323aaf98e630 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:47.399645 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1630ada6-b2c7-47da-a27b-323aaf98e630 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:47.400089 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1630ada6-b2c7-47da-a27b-323aaf98e630 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:47.400848 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1630ada6-b2c7-47da-a27b-323aaf98e630 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:47.401282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1630ada6-b2c7-47da-a27b-323aaf98e630 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:47.432066 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-1630ada6-b2c7-47da-a27b-323aaf98e630 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147/os-volume_attachments/7dfc08ea-bb86-4796-905e-b625426bbf69" status: 200 len: 194 microversion: 2.1 time: 0.046970 Jul 13 21:14:47.432640 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 546/1071] 10.222.0.39 () {58 vars in 1412 bytes} [Wed Jul 13 21:14:47 2022] GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147/os-volume_attachments/7dfc08ea-bb86-4796-905e-b625426bbf69 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:14:47.443151 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-1f2e62eb-127b-44bb-804a-06e3e232f8c6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:47.443631 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-1f2e62eb-127b-44bb-804a-06e3e232f8c6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:47.449832 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1f2e62eb-127b-44bb-804a-06e3e232f8c6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:47.450251 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1f2e62eb-127b-44bb-804a-06e3e232f8c6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:47.451119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1f2e62eb-127b-44bb-804a-06e3e232f8c6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:47.451593 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1f2e62eb-127b-44bb-804a-06e3e232f8c6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:47.688655 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.objects.instance [None req-1f2e62eb-127b-44bb-804a-06e3e232f8c6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lazy-loading 'services' on Instance uuid 5a73f467-e517-4167-83fe-faad603cc147 {{(pid=118444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:14:47.757237 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-1f2e62eb-127b-44bb-804a-06e3e232f8c6 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147/os-volume_attachments/7dfc08ea-bb86-4796-905e-b625426bbf69" status: 202 len: 0 microversion: 2.1 time: 0.318088 Jul 13 21:14:47.757828 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 526/1072] 10.222.0.39 () {58 vars in 1415 bytes} [Wed Jul 13 21:14:47 2022] DELETE /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147/os-volume_attachments/7dfc08ea-bb86-4796-905e-b625426bbf69 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 21:14:54.126731 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-203116ac-604a-4e3c-a0c4-4d9039aed98e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:54.127286 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-203116ac-604a-4e3c-a0c4-4d9039aed98e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:54.134079 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-203116ac-604a-4e3c-a0c4-4d9039aed98e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:54.134450 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-203116ac-604a-4e3c-a0c4-4d9039aed98e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:54.135231 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-203116ac-604a-4e3c-a0c4-4d9039aed98e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:54.135659 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-203116ac-604a-4e3c-a0c4-4d9039aed98e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:54.165952 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-203116ac-604a-4e3c-a0c4-4d9039aed98e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147/os-volume_attachments/5c3e9243-3ce2-4d3d-84d4-5a4208e803ed" status: 200 len: 194 microversion: 2.1 time: 0.043115 Jul 13 21:14:54.166534 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 547/1073] 10.222.0.39 () {58 vars in 1412 bytes} [Wed Jul 13 21:14:54 2022] GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147/os-volume_attachments/5c3e9243-3ce2-4d3d-84d4-5a4208e803ed => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:14:54.176832 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-d4148d62-9ec2-4372-86fd-aa7866fbdfce tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:54.177406 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-d4148d62-9ec2-4372-86fd-aa7866fbdfce tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:54.183609 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d4148d62-9ec2-4372-86fd-aa7866fbdfce tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:54.184052 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d4148d62-9ec2-4372-86fd-aa7866fbdfce tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:54.184804 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d4148d62-9ec2-4372-86fd-aa7866fbdfce tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:54.185235 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d4148d62-9ec2-4372-86fd-aa7866fbdfce tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:54.266393 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.objects.instance [None req-d4148d62-9ec2-4372-86fd-aa7866fbdfce tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lazy-loading 'services' on Instance uuid 5a73f467-e517-4167-83fe-faad603cc147 {{(pid=118444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:14:54.335992 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-d4148d62-9ec2-4372-86fd-aa7866fbdfce tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147/os-volume_attachments/5c3e9243-3ce2-4d3d-84d4-5a4208e803ed" status: 202 len: 0 microversion: 2.1 time: 0.163302 Jul 13 21:14:54.336530 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 527/1074] 10.222.0.39 () {58 vars in 1415 bytes} [Wed Jul 13 21:14:54 2022] DELETE /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147/os-volume_attachments/5c3e9243-3ce2-4d3d-84d4-5a4208e803ed => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 21:14:55.490091 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-77b8dae3-0f62-4bb8-b901-521aed43107e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:55.491083 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-77b8dae3-0f62-4bb8-b901-521aed43107e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:55.497375 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-77b8dae3-0f62-4bb8-b901-521aed43107e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:55.497816 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-77b8dae3-0f62-4bb8-b901-521aed43107e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:55.498566 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-77b8dae3-0f62-4bb8-b901-521aed43107e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:55.499017 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-77b8dae3-0f62-4bb8-b901-521aed43107e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:55.526750 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-77b8dae3-0f62-4bb8-b901-521aed43107e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040484 Jul 13 21:14:55.527331 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 548/1075] 10.222.0.39 () {58 vars in 1301 bytes} [Wed Jul 13 21:14:55 2022] GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 13 21:14:55.628258 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0efad8db-c2f0-48e9-a7ed-a592323eddfa tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:55.629372 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-0efad8db-c2f0-48e9-a7ed-a592323eddfa tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:55.635743 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0efad8db-c2f0-48e9-a7ed-a592323eddfa tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:55.636191 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0efad8db-c2f0-48e9-a7ed-a592323eddfa tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:55.636947 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0efad8db-c2f0-48e9-a7ed-a592323eddfa tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:55.637381 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0efad8db-c2f0-48e9-a7ed-a592323eddfa tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:55.666088 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-0efad8db-c2f0-48e9-a7ed-a592323eddfa tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042473 Jul 13 21:14:55.666646 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 528/1076] 10.222.0.39 () {58 vars in 1301 bytes} [Wed Jul 13 21:14:55 2022] GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 13 21:14:55.721807 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-0edd95d2-be4c-40ce-8bdd-1cb765109d98 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:55.722290 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-0edd95d2-be4c-40ce-8bdd-1cb765109d98 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:55.728228 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0edd95d2-be4c-40ce-8bdd-1cb765109d98 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:55.728667 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0edd95d2-be4c-40ce-8bdd-1cb765109d98 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:55.729411 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0edd95d2-be4c-40ce-8bdd-1cb765109d98 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:55.729837 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0edd95d2-be4c-40ce-8bdd-1cb765109d98 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:55.753702 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-0edd95d2-be4c-40ce-8bdd-1cb765109d98 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Going to try to terminate instance {{(pid=118445) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 21:14:55.824778 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-0edd95d2-be4c-40ce-8bdd-1cb765109d98 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147" status: 204 len: 0 microversion: 2.1 time: 0.107102 Jul 13 21:14:55.825276 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 549/1077] 10.222.0.39 () {58 vars in 1238 bytes} [Wed Jul 13 21:14:55 2022] DELETE /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 21:14:55.835354 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-2d2b8451-933f-4799-a639-43d51e8c5670 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:55.835967 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-2d2b8451-933f-4799-a639-43d51e8c5670 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:55.841890 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2d2b8451-933f-4799-a639-43d51e8c5670 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:55.842755 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2d2b8451-933f-4799-a639-43d51e8c5670 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:55.843521 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2d2b8451-933f-4799-a639-43d51e8c5670 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:55.843961 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2d2b8451-933f-4799-a639-43d51e8c5670 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:55.972778 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-2d2b8451-933f-4799-a639-43d51e8c5670 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:55.981308 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-2d2b8451-933f-4799-a639-43d51e8c5670 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147" status: 200 len: 1674 microversion: 2.1 time: 0.149114 Jul 13 21:14:55.982066 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 529/1078] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:14:55 2022] GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:14:56.999278 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-044586ac-534a-42c9-ab45-c2e86bce817e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:56.999963 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-044586ac-534a-42c9-ab45-c2e86bce817e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:57.006353 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-044586ac-534a-42c9-ab45-c2e86bce817e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:57.006827 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-044586ac-534a-42c9-ab45-c2e86bce817e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:57.007579 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-044586ac-534a-42c9-ab45-c2e86bce817e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:57.008009 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-044586ac-534a-42c9-ab45-c2e86bce817e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:57.290464 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-044586ac-534a-42c9-ab45-c2e86bce817e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:57.297880 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-044586ac-534a-42c9-ab45-c2e86bce817e tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147" status: 200 len: 1674 microversion: 2.1 time: 0.302874 Jul 13 21:14:57.298432 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 550/1079] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:14:56 2022] GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147 => generated 1674 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:14:58.314980 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-eb038bb7-a90c-4b42-a134-d81e649a834b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:58.315531 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-eb038bb7-a90c-4b42-a134-d81e649a834b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:58.322485 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eb038bb7-a90c-4b42-a134-d81e649a834b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:58.322965 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eb038bb7-a90c-4b42-a134-d81e649a834b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:58.323736 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eb038bb7-a90c-4b42-a134-d81e649a834b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:58.324168 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eb038bb7-a90c-4b42-a134-d81e649a834b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:58.707443 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-eb038bb7-a90c-4b42-a134-d81e649a834b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4afeb23348438eabfe22f1a975f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bc9f9f4bc04202aabc75fc4bb9a6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:14:58.715159 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-eb038bb7-a90c-4b42-a134-d81e649a834b tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147" status: 200 len: 1674 microversion: 2.1 time: 0.404240 Jul 13 21:14:58.715760 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 530/1080] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:14:58 2022] GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147 => generated 1674 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:14:59.129081 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-9940fc19-58bf-4fa7-bdf6-c082dcd0a2d1 req-a4ee393d-11f0-492e-bf34-3a4f5eedc255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a73f467-e517-4167-83fe-faad603cc147", "name": "network-vif-deleted", "tag": "2ab1c1b6-5a22-428f-9915-264ae0e6ff92"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:14:59.139481 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-9940fc19-58bf-4fa7-bdf6-c082dcd0a2d1 req-a4ee393d-11f0-492e-bf34-3a4f5eedc255 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:59.139840 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-9940fc19-58bf-4fa7-bdf6-c082dcd0a2d1 req-a4ee393d-11f0-492e-bf34-3a4f5eedc255 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:59.150886 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-9940fc19-58bf-4fa7-bdf6-c082dcd0a2d1 req-a4ee393d-11f0-492e-bf34-3a4f5eedc255 service nova] Creating event network-vif-deleted:2ab1c1b6-5a22-428f-9915-264ae0e6ff92 for instance 5a73f467-e517-4167-83fe-faad603cc147 on hv-cinder-79987 Jul 13 21:14:59.155827 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-9940fc19-58bf-4fa7-bdf6-c082dcd0a2d1 req-a4ee393d-11f0-492e-bf34-3a4f5eedc255 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030517 Jul 13 21:14:59.156701 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 551/1081] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:14:59.733718 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ec8f4d02-0f4a-49ba-b2ff-3206c8903ddc tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:59.735145 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-ec8f4d02-0f4a-49ba-b2ff-3206c8903ddc tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:14:59.741703 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ec8f4d02-0f4a-49ba-b2ff-3206c8903ddc tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:59.742161 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ec8f4d02-0f4a-49ba-b2ff-3206c8903ddc tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:59.742956 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ec8f4d02-0f4a-49ba-b2ff-3206c8903ddc tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:14:59.743401 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ec8f4d02-0f4a-49ba-b2ff-3206c8903ddc tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:14:59.756944 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.wsgi [None req-ec8f4d02-0f4a-49ba-b2ff-3206c8903ddc tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] HTTP exception thrown: Instance 5a73f467-e517-4167-83fe-faad603cc147 could not be found. Jul 13 21:14:59.758952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ec8f4d02-0f4a-49ba-b2ff-3206c8903ddc tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Request method failure captured: Jul 13 21:14:59.758952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: request: GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147 HTTP/1.1 Jul 13 21:14:59.758952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept: application/json Jul 13 21:14:59.758952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept-Encoding: identity Jul 13 21:14:59.758952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Connection: close Jul 13 21:14:59.758952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Length: 0 Jul 13 21:14:59.758952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Type: application/json Jul 13 21:14:59.758952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Host: 10.222.0.39 Jul 13 21:14:59.758952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Openstack-System-Scope: None Jul 13 21:14:59.758952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: User-Agent: python-urllib3/1.26.9 Jul 13 21:14:59.758952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Auth-Token: gAAAAABizzNnvTEZiOI9_WlVX5CVvpy3Mj2Fw5_JARaCLdXGG_S6rROVCIuEop7Bz-S9cxE-6ldc4jk9UXXteYr4spop1Oa2maIgRtkRboGZ9SaHekO4zqkoarKFomW_rivVAK5---K6IL4ITQLBj67A4zvHIZ_4zm2h5PrgbUsGISwn-mIDVrY Jul 13 21:14:59.758952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Id: None Jul 13 21:14:59.758952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Name: None Jul 13 21:14:59.758952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Identity-Status: Confirmed Jul 13 21:14:59.758952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Is-Admin-Project: True Jul 13 21:14:59.758952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Id: default Jul 13 21:14:59.758952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Name: Default Jul 13 21:14:59.758952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Id: 91bc9f9f4bc04202aabc75fc4bb9a6b2 Jul 13 21:14:59.758952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Name: tempest-AttachVolumeTestJSON-740956243 Jul 13 21:14:59.758952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Role: member,reader Jul 13 21:14:59.758952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Roles: member,reader Jul 13 21:14:59.760388 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91bc9f9f4bc04202aabc75fc4bb9a6b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/91bc9f9f4bc04202aabc75fc4bb9a6b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_91bc9f9f4bc04202aabc75fc4bb9a6b2", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91bc9f9f4bc04202aabc75fc4bb9a6b2"}]}] Jul 13 21:14:59.760388 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant: tempest-AttachVolumeTestJSON-740956243 Jul 13 21:14:59.760388 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Id: 91bc9f9f4bc04202aabc75fc4bb9a6b2 Jul 13 21:14:59.760388 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Name: tempest-AttachVolumeTestJSON-740956243 Jul 13 21:14:59.760388 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User: tempest-AttachVolumeTestJSON-740956243-project Jul 13 21:14:59.760388 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Id: default Jul 13 21:14:59.760388 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Name: Default Jul 13 21:14:59.760388 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Id: fc4afeb23348438eabfe22f1a975f9ab Jul 13 21:14:59.760388 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Name: tempest-AttachVolumeTestJSON-740956243-project Jul 13 21:14:59.760388 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: method: > Jul 13 21:14:59.760388 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: exception: Instance 5a73f467-e517-4167-83fe-faad603cc147 could not be found. Jul 13 21:14:59.760388 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: action_args: {'id': '5a73f467-e517-4167-83fe-faad603cc147'} Jul 13 21:14:59.761192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:14:59.761192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:14:59.761192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:14:59.761192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:14:59.761192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:14:59.761192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:14:59.761192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:14:59.761192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:14:59.761192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:14:59.761192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:14:59.761192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a73f467-e517-4167-83fe-faad603cc147 could not be found. Jul 13 21:14:59.761192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:14:59.761192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:14:59.761192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:14:59.761192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:14:59.761192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:14:59.761192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:14:59.761192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:14:59.761192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:14:59.761192 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:14:59.762513 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:14:59.762513 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 21:14:59.762513 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 21:14:59.762513 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:14:59.762513 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:14:59.762513 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:14:59.762513 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:14:59.762513 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a73f467-e517-4167-83fe-faad603cc147 could not be found. Jul 13 21:14:59.762513 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:14:59.762513 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:14:59.762513 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:14:59.762513 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:14:59.762513 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:14:59.762513 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:14:59.762513 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:14:59.762513 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:14:59.762513 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a73f467-e517-4167-83fe-faad603cc147 could not be found. Jul 13 21:14:59.762513 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:14:59.763735 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ec8f4d02-0f4a-49ba-b2ff-3206c8903ddc tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Returning 404 to user: Instance 5a73f467-e517-4167-83fe-faad603cc147 could not be found. {{(pid=118444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:14:59.763735 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ec8f4d02-0f4a-49ba-b2ff-3206c8903ddc tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147" status: 404 len: 111 microversion: 2.1 time: 0.031094 Jul 13 21:14:59.763735 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 531/1082] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:14:59 2022] GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:14:59.769701 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-41c9a973-5526-481f-8cb1-aa2aeed13f1c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '.version_select at 0x7f96e8b1d670>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:14:59.788154 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-41c9a973-5526-481f-8cb1-aa2aeed13f1c tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-709840540" status: 202 len: 0 microversion: 2.1 time: 0.022565 Jul 13 21:14:59.788725 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 552/1083] 10.222.0.39 () {58 vars in 1217 bytes} [Wed Jul 13 21:14:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-709840540 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 21:15:02.661346 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-f9980144-c58b-4e4a-9ba1-90963b1ca0ce tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:02.661868 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-f9980144-c58b-4e4a-9ba1-90963b1ca0ce tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:02.668582 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f9980144-c58b-4e4a-9ba1-90963b1ca0ce tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:02.669032 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f9980144-c58b-4e4a-9ba1-90963b1ca0ce tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:02.669785 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f9980144-c58b-4e4a-9ba1-90963b1ca0ce tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:02.670839 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f9980144-c58b-4e4a-9ba1-90963b1ca0ce tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:02.685355 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.wsgi [None req-f9980144-c58b-4e4a-9ba1-90963b1ca0ce tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] HTTP exception thrown: Instance 5a73f467-e517-4167-83fe-faad603cc147 could not be found. Jul 13 21:15:02.686985 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-f9980144-c58b-4e4a-9ba1-90963b1ca0ce tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Request method failure captured: Jul 13 21:15:02.686985 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: request: DELETE /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147 HTTP/1.1 Jul 13 21:15:02.686985 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept: application/json Jul 13 21:15:02.686985 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept-Encoding: identity Jul 13 21:15:02.686985 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Connection: close Jul 13 21:15:02.686985 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Length: 0 Jul 13 21:15:02.686985 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Type: application/json Jul 13 21:15:02.686985 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Host: 10.222.0.39 Jul 13 21:15:02.686985 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Openstack-System-Scope: None Jul 13 21:15:02.686985 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: User-Agent: python-urllib3/1.26.9 Jul 13 21:15:02.686985 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Auth-Token: gAAAAABizzNnvTEZiOI9_WlVX5CVvpy3Mj2Fw5_JARaCLdXGG_S6rROVCIuEop7Bz-S9cxE-6ldc4jk9UXXteYr4spop1Oa2maIgRtkRboGZ9SaHekO4zqkoarKFomW_rivVAK5---K6IL4ITQLBj67A4zvHIZ_4zm2h5PrgbUsGISwn-mIDVrY Jul 13 21:15:02.686985 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Id: None Jul 13 21:15:02.686985 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Name: None Jul 13 21:15:02.686985 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Identity-Status: Confirmed Jul 13 21:15:02.686985 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Is-Admin-Project: True Jul 13 21:15:02.686985 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Id: default Jul 13 21:15:02.686985 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Name: Default Jul 13 21:15:02.686985 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Id: 91bc9f9f4bc04202aabc75fc4bb9a6b2 Jul 13 21:15:02.686985 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Name: tempest-AttachVolumeTestJSON-740956243 Jul 13 21:15:02.686985 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Role: member,reader Jul 13 21:15:02.686985 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Roles: member,reader Jul 13 21:15:02.688326 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91bc9f9f4bc04202aabc75fc4bb9a6b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/91bc9f9f4bc04202aabc75fc4bb9a6b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_91bc9f9f4bc04202aabc75fc4bb9a6b2", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91bc9f9f4bc04202aabc75fc4bb9a6b2"}]}] Jul 13 21:15:02.688326 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant: tempest-AttachVolumeTestJSON-740956243 Jul 13 21:15:02.688326 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Id: 91bc9f9f4bc04202aabc75fc4bb9a6b2 Jul 13 21:15:02.688326 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Name: tempest-AttachVolumeTestJSON-740956243 Jul 13 21:15:02.688326 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User: tempest-AttachVolumeTestJSON-740956243-project Jul 13 21:15:02.688326 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Id: default Jul 13 21:15:02.688326 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Name: Default Jul 13 21:15:02.688326 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Id: fc4afeb23348438eabfe22f1a975f9ab Jul 13 21:15:02.688326 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Name: tempest-AttachVolumeTestJSON-740956243-project Jul 13 21:15:02.688326 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: method: > Jul 13 21:15:02.688326 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: exception: Instance 5a73f467-e517-4167-83fe-faad603cc147 could not be found. Jul 13 21:15:02.688326 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: action_args: {'id': '5a73f467-e517-4167-83fe-faad603cc147'} Jul 13 21:15:02.689062 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:15:02.689062 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:02.689062 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:15:02.689062 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:15:02.689062 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:15:02.689062 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:15:02.689062 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:15:02.689062 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:15:02.689062 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:15:02.689062 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:15:02.689062 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a73f467-e517-4167-83fe-faad603cc147 could not be found. Jul 13 21:15:02.689062 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:02.689062 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:02.689062 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:02.689062 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:02.689062 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:02.689062 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:02.689062 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:15:02.689062 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:15:02.689062 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:15:02.690382 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:15:02.690382 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 13 21:15:02.690382 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 13 21:15:02.690382 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 13 21:15:02.690382 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 13 21:15:02.690382 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:15:02.690382 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:15:02.690382 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:15:02.690382 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:15:02.690382 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a73f467-e517-4167-83fe-faad603cc147 could not be found. Jul 13 21:15:02.690382 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:02.690382 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:02.690382 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:02.690382 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:02.690382 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:02.690382 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:02.690382 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:15:02.690382 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:15:02.690382 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a73f467-e517-4167-83fe-faad603cc147 could not be found. Jul 13 21:15:02.690382 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:02.692897 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-f9980144-c58b-4e4a-9ba1-90963b1ca0ce tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Returning 404 to user: Instance 5a73f467-e517-4167-83fe-faad603cc147 could not be found. {{(pid=118444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:15:02.693726 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-f9980144-c58b-4e4a-9ba1-90963b1ca0ce tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147" status: 404 len: 111 microversion: 2.1 time: 0.036165 Jul 13 21:15:02.694267 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 532/1084] 10.222.0.39 () {58 vars in 1238 bytes} [Wed Jul 13 21:15:02 2022] DELETE /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:15:02.702823 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-bb61b280-96b2-4ade-94e2-28d550b83674 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:02.704145 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-bb61b280-96b2-4ade-94e2-28d550b83674 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: 5a73f467-e517-4167-83fe-faad603cc147] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:02.710546 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bb61b280-96b2-4ade-94e2-28d550b83674 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:02.711092 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bb61b280-96b2-4ade-94e2-28d550b83674 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:02.711918 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bb61b280-96b2-4ade-94e2-28d550b83674 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:02.712416 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bb61b280-96b2-4ade-94e2-28d550b83674 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:02.725891 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.wsgi [None req-bb61b280-96b2-4ade-94e2-28d550b83674 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] HTTP exception thrown: Instance 5a73f467-e517-4167-83fe-faad603cc147 could not be found. Jul 13 21:15:02.727610 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-bb61b280-96b2-4ade-94e2-28d550b83674 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Request method failure captured: Jul 13 21:15:02.727610 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: request: GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147 HTTP/1.1 Jul 13 21:15:02.727610 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept: application/json Jul 13 21:15:02.727610 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept-Encoding: identity Jul 13 21:15:02.727610 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Connection: close Jul 13 21:15:02.727610 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Length: 0 Jul 13 21:15:02.727610 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Type: application/json Jul 13 21:15:02.727610 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Host: 10.222.0.39 Jul 13 21:15:02.727610 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Openstack-System-Scope: None Jul 13 21:15:02.727610 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: User-Agent: python-urllib3/1.26.9 Jul 13 21:15:02.727610 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Auth-Token: gAAAAABizzNnvTEZiOI9_WlVX5CVvpy3Mj2Fw5_JARaCLdXGG_S6rROVCIuEop7Bz-S9cxE-6ldc4jk9UXXteYr4spop1Oa2maIgRtkRboGZ9SaHekO4zqkoarKFomW_rivVAK5---K6IL4ITQLBj67A4zvHIZ_4zm2h5PrgbUsGISwn-mIDVrY Jul 13 21:15:02.727610 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Id: None Jul 13 21:15:02.727610 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Name: None Jul 13 21:15:02.727610 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Identity-Status: Confirmed Jul 13 21:15:02.727610 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Is-Admin-Project: True Jul 13 21:15:02.727610 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Id: default Jul 13 21:15:02.727610 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Name: Default Jul 13 21:15:02.727610 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Id: 91bc9f9f4bc04202aabc75fc4bb9a6b2 Jul 13 21:15:02.727610 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Name: tempest-AttachVolumeTestJSON-740956243 Jul 13 21:15:02.727610 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Role: member,reader Jul 13 21:15:02.727610 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Roles: member,reader Jul 13 21:15:02.729273 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91bc9f9f4bc04202aabc75fc4bb9a6b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/91bc9f9f4bc04202aabc75fc4bb9a6b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_91bc9f9f4bc04202aabc75fc4bb9a6b2", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91bc9f9f4bc04202aabc75fc4bb9a6b2"}]}] Jul 13 21:15:02.729273 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant: tempest-AttachVolumeTestJSON-740956243 Jul 13 21:15:02.729273 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Id: 91bc9f9f4bc04202aabc75fc4bb9a6b2 Jul 13 21:15:02.729273 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Name: tempest-AttachVolumeTestJSON-740956243 Jul 13 21:15:02.729273 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User: tempest-AttachVolumeTestJSON-740956243-project Jul 13 21:15:02.729273 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Id: default Jul 13 21:15:02.729273 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Name: Default Jul 13 21:15:02.729273 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Id: fc4afeb23348438eabfe22f1a975f9ab Jul 13 21:15:02.729273 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Name: tempest-AttachVolumeTestJSON-740956243-project Jul 13 21:15:02.729273 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: method: > Jul 13 21:15:02.729273 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: exception: Instance 5a73f467-e517-4167-83fe-faad603cc147 could not be found. Jul 13 21:15:02.729273 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: action_args: {'id': '5a73f467-e517-4167-83fe-faad603cc147'} Jul 13 21:15:02.730138 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:15:02.730138 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:02.730138 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:15:02.730138 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:15:02.730138 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:15:02.730138 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:15:02.730138 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:15:02.730138 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:15:02.730138 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:15:02.730138 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:15:02.730138 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a73f467-e517-4167-83fe-faad603cc147 could not be found. Jul 13 21:15:02.730138 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:02.730138 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:02.730138 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:02.730138 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:02.730138 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:02.730138 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:02.730138 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:15:02.730138 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:15:02.730138 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:15:02.731655 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:15:02.731655 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 21:15:02.731655 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 21:15:02.731655 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:15:02.731655 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:15:02.731655 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:15:02.731655 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:15:02.731655 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a73f467-e517-4167-83fe-faad603cc147 could not be found. Jul 13 21:15:02.731655 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:02.731655 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:02.731655 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:02.731655 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:02.731655 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:02.731655 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:02.731655 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:15:02.731655 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:15:02.731655 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a73f467-e517-4167-83fe-faad603cc147 could not be found. Jul 13 21:15:02.731655 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:02.733149 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-bb61b280-96b2-4ade-94e2-28d550b83674 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Returning 404 to user: Instance 5a73f467-e517-4167-83fe-faad603cc147 could not be found. {{(pid=118445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:15:02.733149 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-bb61b280-96b2-4ade-94e2-28d550b83674 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147" status: 404 len: 111 microversion: 2.1 time: 0.033056 Jul 13 21:15:02.733612 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 553/1085] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:15:02 2022] GET /compute/v2.1/servers/5a73f467-e517-4167-83fe-faad603cc147 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:15:03.870966 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-08ba2b5b-0c44-428d-a5fc-8ccddfe892d2 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:03.871464 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-08ba2b5b-0c44-428d-a5fc-8ccddfe892d2 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:03.878505 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-08ba2b5b-0c44-428d-a5fc-8ccddfe892d2 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:03.878980 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-08ba2b5b-0c44-428d-a5fc-8ccddfe892d2 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:03.879730 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-08ba2b5b-0c44-428d-a5fc-8ccddfe892d2 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:03.880161 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-08ba2b5b-0c44-428d-a5fc-8ccddfe892d2 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:03.893527 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.wsgi [None req-08ba2b5b-0c44-428d-a5fc-8ccddfe892d2 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] HTTP exception thrown: Instance bcbf4753-6006-45d1-af09-33b6f6047153 could not be found. Jul 13 21:15:03.895074 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-08ba2b5b-0c44-428d-a5fc-8ccddfe892d2 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Request method failure captured: Jul 13 21:15:03.895074 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: request: DELETE /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 HTTP/1.1 Jul 13 21:15:03.895074 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept: application/json Jul 13 21:15:03.895074 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept-Encoding: identity Jul 13 21:15:03.895074 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Connection: close Jul 13 21:15:03.895074 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Length: 0 Jul 13 21:15:03.895074 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Type: application/json Jul 13 21:15:03.895074 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Host: 10.222.0.39 Jul 13 21:15:03.895074 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Openstack-System-Scope: None Jul 13 21:15:03.895074 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: User-Agent: python-urllib3/1.26.9 Jul 13 21:15:03.895074 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Auth-Token: gAAAAABizzNnvTEZiOI9_WlVX5CVvpy3Mj2Fw5_JARaCLdXGG_S6rROVCIuEop7Bz-S9cxE-6ldc4jk9UXXteYr4spop1Oa2maIgRtkRboGZ9SaHekO4zqkoarKFomW_rivVAK5---K6IL4ITQLBj67A4zvHIZ_4zm2h5PrgbUsGISwn-mIDVrY Jul 13 21:15:03.895074 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Id: None Jul 13 21:15:03.895074 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Name: None Jul 13 21:15:03.895074 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Identity-Status: Confirmed Jul 13 21:15:03.895074 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Is-Admin-Project: True Jul 13 21:15:03.895074 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Id: default Jul 13 21:15:03.895074 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Name: Default Jul 13 21:15:03.895074 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Id: 91bc9f9f4bc04202aabc75fc4bb9a6b2 Jul 13 21:15:03.895074 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Name: tempest-AttachVolumeTestJSON-740956243 Jul 13 21:15:03.895074 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Role: member,reader Jul 13 21:15:03.895074 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Roles: member,reader Jul 13 21:15:03.896634 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91bc9f9f4bc04202aabc75fc4bb9a6b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/91bc9f9f4bc04202aabc75fc4bb9a6b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_91bc9f9f4bc04202aabc75fc4bb9a6b2", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91bc9f9f4bc04202aabc75fc4bb9a6b2"}]}] Jul 13 21:15:03.896634 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant: tempest-AttachVolumeTestJSON-740956243 Jul 13 21:15:03.896634 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Id: 91bc9f9f4bc04202aabc75fc4bb9a6b2 Jul 13 21:15:03.896634 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Name: tempest-AttachVolumeTestJSON-740956243 Jul 13 21:15:03.896634 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User: tempest-AttachVolumeTestJSON-740956243-project Jul 13 21:15:03.896634 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Id: default Jul 13 21:15:03.896634 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Name: Default Jul 13 21:15:03.896634 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Id: fc4afeb23348438eabfe22f1a975f9ab Jul 13 21:15:03.896634 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Name: tempest-AttachVolumeTestJSON-740956243-project Jul 13 21:15:03.896634 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: method: > Jul 13 21:15:03.896634 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: exception: Instance bcbf4753-6006-45d1-af09-33b6f6047153 could not be found. Jul 13 21:15:03.896634 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: action_args: {'id': 'bcbf4753-6006-45d1-af09-33b6f6047153'} Jul 13 21:15:03.897424 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:15:03.897424 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:03.897424 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:15:03.897424 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:15:03.897424 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:15:03.897424 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:15:03.897424 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:15:03.897424 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:15:03.897424 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:15:03.897424 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:15:03.897424 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcbf4753-6006-45d1-af09-33b6f6047153 could not be found. Jul 13 21:15:03.897424 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:03.897424 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:03.897424 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:03.897424 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:03.897424 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:03.897424 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:03.897424 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:15:03.897424 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:15:03.897424 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:15:03.898823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:15:03.898823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 13 21:15:03.898823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 13 21:15:03.898823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 13 21:15:03.898823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 13 21:15:03.898823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:15:03.898823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:15:03.898823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:15:03.898823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:15:03.898823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcbf4753-6006-45d1-af09-33b6f6047153 could not be found. Jul 13 21:15:03.898823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:03.898823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:03.898823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:03.898823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:03.898823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:03.898823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:03.898823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:15:03.898823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:15:03.898823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcbf4753-6006-45d1-af09-33b6f6047153 could not be found. Jul 13 21:15:03.898823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:03.900225 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-08ba2b5b-0c44-428d-a5fc-8ccddfe892d2 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Returning 404 to user: Instance bcbf4753-6006-45d1-af09-33b6f6047153 could not be found. {{(pid=118444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:15:03.900225 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-08ba2b5b-0c44-428d-a5fc-8ccddfe892d2 tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "DELETE /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 404 len: 111 microversion: 2.1 time: 0.029329 Jul 13 21:15:03.900225 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 533/1086] 10.222.0.39 () {58 vars in 1238 bytes} [Wed Jul 13 21:15:03 2022] DELETE /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:15:03.904708 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-4facbe25-fc7d-4391-b9e1-9b84cbeb47ed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:03.905315 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-4facbe25-fc7d-4391-b9e1-9b84cbeb47ed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] [instance: bcbf4753-6006-45d1-af09-33b6f6047153] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:03.911677 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4facbe25-fc7d-4391-b9e1-9b84cbeb47ed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:03.912147 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4facbe25-fc7d-4391-b9e1-9b84cbeb47ed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:03.912901 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4facbe25-fc7d-4391-b9e1-9b84cbeb47ed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:03.913332 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4facbe25-fc7d-4391-b9e1-9b84cbeb47ed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:03.926845 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.wsgi [None req-4facbe25-fc7d-4391-b9e1-9b84cbeb47ed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] HTTP exception thrown: Instance bcbf4753-6006-45d1-af09-33b6f6047153 could not be found. Jul 13 21:15:03.928325 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-4facbe25-fc7d-4391-b9e1-9b84cbeb47ed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Request method failure captured: Jul 13 21:15:03.928325 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: request: GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 HTTP/1.1 Jul 13 21:15:03.928325 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept: application/json Jul 13 21:15:03.928325 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept-Encoding: identity Jul 13 21:15:03.928325 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Connection: close Jul 13 21:15:03.928325 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Length: 0 Jul 13 21:15:03.928325 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Type: application/json Jul 13 21:15:03.928325 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Host: 10.222.0.39 Jul 13 21:15:03.928325 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Openstack-System-Scope: None Jul 13 21:15:03.928325 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: User-Agent: python-urllib3/1.26.9 Jul 13 21:15:03.928325 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Auth-Token: gAAAAABizzNnvTEZiOI9_WlVX5CVvpy3Mj2Fw5_JARaCLdXGG_S6rROVCIuEop7Bz-S9cxE-6ldc4jk9UXXteYr4spop1Oa2maIgRtkRboGZ9SaHekO4zqkoarKFomW_rivVAK5---K6IL4ITQLBj67A4zvHIZ_4zm2h5PrgbUsGISwn-mIDVrY Jul 13 21:15:03.928325 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Id: None Jul 13 21:15:03.928325 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Name: None Jul 13 21:15:03.928325 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Identity-Status: Confirmed Jul 13 21:15:03.928325 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Is-Admin-Project: True Jul 13 21:15:03.928325 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Id: default Jul 13 21:15:03.928325 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Name: Default Jul 13 21:15:03.928325 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Id: 91bc9f9f4bc04202aabc75fc4bb9a6b2 Jul 13 21:15:03.928325 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Name: tempest-AttachVolumeTestJSON-740956243 Jul 13 21:15:03.928325 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Role: member,reader Jul 13 21:15:03.928325 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Roles: member,reader Jul 13 21:15:03.929880 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91bc9f9f4bc04202aabc75fc4bb9a6b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/91bc9f9f4bc04202aabc75fc4bb9a6b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_91bc9f9f4bc04202aabc75fc4bb9a6b2", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91bc9f9f4bc04202aabc75fc4bb9a6b2"}]}] Jul 13 21:15:03.929880 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant: tempest-AttachVolumeTestJSON-740956243 Jul 13 21:15:03.929880 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Id: 91bc9f9f4bc04202aabc75fc4bb9a6b2 Jul 13 21:15:03.929880 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Name: tempest-AttachVolumeTestJSON-740956243 Jul 13 21:15:03.929880 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User: tempest-AttachVolumeTestJSON-740956243-project Jul 13 21:15:03.929880 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Id: default Jul 13 21:15:03.929880 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Name: Default Jul 13 21:15:03.929880 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Id: fc4afeb23348438eabfe22f1a975f9ab Jul 13 21:15:03.929880 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Name: tempest-AttachVolumeTestJSON-740956243-project Jul 13 21:15:03.929880 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: method: > Jul 13 21:15:03.929880 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: exception: Instance bcbf4753-6006-45d1-af09-33b6f6047153 could not be found. Jul 13 21:15:03.929880 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: action_args: {'id': 'bcbf4753-6006-45d1-af09-33b6f6047153'} Jul 13 21:15:03.930833 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:15:03.930833 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:03.930833 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:15:03.930833 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:15:03.930833 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:15:03.930833 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:15:03.930833 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:15:03.930833 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:15:03.930833 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:15:03.930833 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:15:03.930833 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcbf4753-6006-45d1-af09-33b6f6047153 could not be found. Jul 13 21:15:03.930833 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:03.930833 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:03.930833 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:03.930833 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:03.930833 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:03.930833 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:03.930833 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:15:03.930833 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:15:03.930833 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:15:03.932282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:15:03.932282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 21:15:03.932282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 21:15:03.932282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:15:03.932282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:15:03.932282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:15:03.932282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:15:03.932282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcbf4753-6006-45d1-af09-33b6f6047153 could not be found. Jul 13 21:15:03.932282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:03.932282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:03.932282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:03.932282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:03.932282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:03.932282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:03.932282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:15:03.932282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:15:03.932282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcbf4753-6006-45d1-af09-33b6f6047153 could not be found. Jul 13 21:15:03.932282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:03.933591 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-4facbe25-fc7d-4391-b9e1-9b84cbeb47ed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] Returning 404 to user: Instance bcbf4753-6006-45d1-af09-33b6f6047153 could not be found. {{(pid=118445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:15:03.933591 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-4facbe25-fc7d-4391-b9e1-9b84cbeb47ed tempest-AttachVolumeTestJSON-740956243 tempest-AttachVolumeTestJSON-740956243-project] 10.222.0.39 "GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153" status: 404 len: 111 microversion: 2.1 time: 0.028753 Jul 13 21:15:03.933591 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 554/1087] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:15:03 2022] GET /compute/v2.1/servers/bcbf4753-6006-45d1-af09-33b6f6047153 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:15:09.294251 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-061499f1-0b91-401d-87a3-40bbebff20dc tempest-VolumesTestJSON-562155698 tempest-VolumesTestJSON-562155698-project] Calling method '.version_select at 0x7f96e86a8670>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:09.342141 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-061499f1-0b91-401d-87a3-40bbebff20dc tempest-VolumesTestJSON-562155698 tempest-VolumesTestJSON-562155698-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/b8bc95ca-e3c9-4898-bbcb-bdf88034c8ef" status: 200 len: 350 microversion: 2.1 time: 0.051554 Jul 13 21:15:09.342715 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 534/1088] 10.222.0.39 () {58 vars in 1244 bytes} [Wed Jul 13 21:15:09 2022] GET /compute/v2.1/os-volumes/b8bc95ca-e3c9-4898-bbcb-bdf88034c8ef => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:15:10.647645 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-7fd229ad-881d-4f04-ab01-d5cbdc8d8b80 tempest-VolumesTestJSON-562155698 tempest-VolumesTestJSON-562155698-project] Calling method '.version_select at 0x7f96e8b92790>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:10.693318 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-7fd229ad-881d-4f04-ab01-d5cbdc8d8b80 tempest-VolumesTestJSON-562155698 tempest-VolumesTestJSON-562155698-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/f09013d9-b66d-4e84-a18c-a2322b17b9d6" status: 200 len: 350 microversion: 2.1 time: 0.049402 Jul 13 21:15:10.693882 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 555/1089] 10.222.0.39 () {58 vars in 1244 bytes} [Wed Jul 13 21:15:10 2022] GET /compute/v2.1/os-volumes/f09013d9-b66d-4e84-a18c-a2322b17b9d6 => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:15:12.018847 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-a8925da4-02e2-4571-ba52-6b463d6259b9 tempest-VolumesTestJSON-562155698 tempest-VolumesTestJSON-562155698-project] Calling method '.version_select at 0x7f96e88ddb80>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:12.063261 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-a8925da4-02e2-4571-ba52-6b463d6259b9 tempest-VolumesTestJSON-562155698 tempest-VolumesTestJSON-562155698-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/71230548-b323-42c0-abdd-947d68a01c2b" status: 200 len: 350 microversion: 2.1 time: 0.049142 Jul 13 21:15:12.063812 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 535/1090] 10.222.0.39 () {58 vars in 1244 bytes} [Wed Jul 13 21:15:12 2022] GET /compute/v2.1/os-volumes/71230548-b323-42c0-abdd-947d68a01c2b => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:15:12.074997 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-af415103-c3be-442c-8e33-dfd61334967a tempest-VolumesTestJSON-562155698 tempest-VolumesTestJSON-562155698-project] Calling method '.version_select at 0x7f96e8abcca0>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:12.156791 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-af415103-c3be-442c-8e33-dfd61334967a tempest-VolumesTestJSON-562155698 tempest-VolumesTestJSON-562155698-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.085914 Jul 13 21:15:12.157353 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 556/1091] 10.222.0.39 () {58 vars in 1133 bytes} [Wed Jul 13 21:15:12 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:15:12.169406 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b22540ce-6a58-4e7d-8079-bf7d7dc23358 tempest-VolumesTestJSON-562155698 tempest-VolumesTestJSON-562155698-project] Calling method '.version_select at 0x7f96e87eb670>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:12.248559 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b22540ce-6a58-4e7d-8079-bf7d7dc23358 tempest-VolumesTestJSON-562155698 tempest-VolumesTestJSON-562155698-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.082798 Jul 13 21:15:12.249678 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 536/1092] 10.222.0.39 () {58 vars in 1148 bytes} [Wed Jul 13 21:15:12 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:15:12.261436 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-f4c5225d-09cd-425b-b24b-2bce8d061e21 tempest-VolumesTestJSON-562155698 tempest-VolumesTestJSON-562155698-project] Calling method '.version_select at 0x7f96e8724dc0>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:12.344705 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-f4c5225d-09cd-425b-b24b-2bce8d061e21 tempest-VolumesTestJSON-562155698 tempest-VolumesTestJSON-562155698-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.087161 Jul 13 21:15:12.345299 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 557/1093] 10.222.0.39 () {58 vars in 1133 bytes} [Wed Jul 13 21:15:12 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:15:12.356197 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ba463cd7-ae3c-43c4-bc0a-60aa45e137cb tempest-VolumesTestJSON-562155698 tempest-VolumesTestJSON-562155698-project] Calling method '.version_select at 0x7f96e86554c0>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:12.433909 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ba463cd7-ae3c-43c4-bc0a-60aa45e137cb tempest-VolumesTestJSON-562155698 tempest-VolumesTestJSON-562155698-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.081418 Jul 13 21:15:12.434466 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 537/1094] 10.222.0.39 () {58 vars in 1166 bytes} [Wed Jul 13 21:15:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:15:12.446241 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-8b641623-44fb-4967-bb52-0e5611a7e0c6 tempest-VolumesTestJSON-562155698 tempest-VolumesTestJSON-562155698-project] Calling method '.version_select at 0x7f96e88b6f70>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:12.524359 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-8b641623-44fb-4967-bb52-0e5611a7e0c6 tempest-VolumesTestJSON-562155698 tempest-VolumesTestJSON-562155698-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.081709 Jul 13 21:15:12.524928 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 558/1095] 10.222.0.39 () {58 vars in 1169 bytes} [Wed Jul 13 21:15:12 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:15:12.536475 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-366b8f15-cc18-48c1-ba6a-6bb1dd76bd6a tempest-VolumesTestJSON-562155698 tempest-VolumesTestJSON-562155698-project] Calling method '.version_select at 0x7f96e890fdc0>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:12.614896 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-366b8f15-cc18-48c1-ba6a-6bb1dd76bd6a tempest-VolumesTestJSON-562155698 tempest-VolumesTestJSON-562155698-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.082002 Jul 13 21:15:12.615463 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 538/1096] 10.222.0.39 () {58 vars in 1154 bytes} [Wed Jul 13 21:15:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:15:12.626900 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-f16c7a49-2a18-48ae-8669-3da2d04720ca tempest-VolumesTestJSON-562155698 tempest-VolumesTestJSON-562155698-project] Calling method '.version_select at 0x7f96e8781940>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:12.707448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-f16c7a49-2a18-48ae-8669-3da2d04720ca tempest-VolumesTestJSON-562155698 tempest-VolumesTestJSON-562155698-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084806 Jul 13 21:15:12.708011 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 559/1097] 10.222.0.39 () {58 vars in 1187 bytes} [Wed Jul 13 21:15:12 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:15:12.719223 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-01202c72-29de-4869-8d00-f1ddfc8d38ee tempest-VolumesTestJSON-562155698 tempest-VolumesTestJSON-562155698-project] Calling method '.version_select at 0x7f96e88dde50>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:12.800633 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-01202c72-29de-4869-8d00-f1ddfc8d38ee tempest-VolumesTestJSON-562155698 tempest-VolumesTestJSON-562155698-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.085093 Jul 13 21:15:12.801202 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 539/1098] 10.222.0.39 () {58 vars in 1154 bytes} [Wed Jul 13 21:15:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:15:12.882787 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-e08dc5fd-cee3-466f-baf7-d3c65f0d44ac tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:12.883279 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-e08dc5fd-cee3-466f-baf7-d3c65f0d44ac tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 22968c28-4691-4e3d-a9e9-dbc923b5fa93] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:12.889813 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e08dc5fd-cee3-466f-baf7-d3c65f0d44ac tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:12.890261 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e08dc5fd-cee3-466f-baf7-d3c65f0d44ac tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:12.891141 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e08dc5fd-cee3-466f-baf7-d3c65f0d44ac tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:12.891621 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e08dc5fd-cee3-466f-baf7-d3c65f0d44ac tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:12.916617 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-e08dc5fd-cee3-466f-baf7-d3c65f0d44ac tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93/ips" status: 200 len: 149 microversion: 2.1 time: 0.037512 Jul 13 21:15:12.917187 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 560/1099] 10.222.0.39 () {58 vars in 1247 bytes} [Wed Jul 13 21:15:12 2022] GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:15:14.231425 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_api:SELECT=18 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:15:14.232178 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=48,nova_cell1:INSERT=2 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:15:14.237215 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ef7bb197-696c-44b2-9914-365f61f92f24 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c710e0e-4157-4c2e-8e96-268a509deef8"}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:15:14.238281 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-ef7bb197-696c-44b2-9914-365f61f92f24 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 22968c28-4691-4e3d-a9e9-dbc923b5fa93] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:14.245586 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ef7bb197-696c-44b2-9914-365f61f92f24 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:14.246039 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ef7bb197-696c-44b2-9914-365f61f92f24 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:14.246841 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ef7bb197-696c-44b2-9914-365f61f92f24 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:14.247286 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ef7bb197-696c-44b2-9914-365f61f92f24 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:14.501839 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ef7bb197-696c-44b2-9914-365f61f92f24 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "POST /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271454 Jul 13 21:15:14.502439 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 540/1100] 10.222.0.39 () {60 vars in 1322 bytes} [Wed Jul 13 21:15:14 2022] POST /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:15:21.536218 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-906dcfd4-275e-41ca-8f29-55b7fa32c6e9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:21.537058 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-906dcfd4-275e-41ca-8f29-55b7fa32c6e9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:21.539672 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:15:21.544931 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-906dcfd4-275e-41ca-8f29-55b7fa32c6e9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:21.545374 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-906dcfd4-275e-41ca-8f29-55b7fa32c6e9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:21.546124 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-906dcfd4-275e-41ca-8f29-55b7fa32c6e9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:21.546549 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-906dcfd4-275e-41ca-8f29-55b7fa32c6e9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:21.551255 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:15:21.577844 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-906dcfd4-275e-41ca-8f29-55b7fa32c6e9 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046044 Jul 13 21:15:21.578380 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 561/1101] 10.222.0.39 () {60 vars in 1342 bytes} [Wed Jul 13 21:15:21 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:15:21.635058 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-5c3ddd05-9c0c-4333-88ce-88890d7beea7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:21.635644 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-5c3ddd05-9c0c-4333-88ce-88890d7beea7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:21.642320 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5c3ddd05-9c0c-4333-88ce-88890d7beea7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:21.642799 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5c3ddd05-9c0c-4333-88ce-88890d7beea7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:21.643562 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5c3ddd05-9c0c-4333-88ce-88890d7beea7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:21.644001 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5c3ddd05-9c0c-4333-88ce-88890d7beea7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:21.668991 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-5c3ddd05-9c0c-4333-88ce-88890d7beea7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Going to try to terminate instance {{(pid=118444) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 21:15:21.741418 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-5c3ddd05-9c0c-4333-88ce-88890d7beea7 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 204 len: 0 microversion: 2.20 time: 0.111173 Jul 13 21:15:21.742002 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 541/1102] 10.222.0.39 () {60 vars in 1279 bytes} [Wed Jul 13 21:15:21 2022] DELETE /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 13 21:15:21.750422 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-5f7d85c0-598d-4ab8-8075-3fbe795dd89e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:21.751018 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-5f7d85c0-598d-4ab8-8075-3fbe795dd89e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:21.757119 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5f7d85c0-598d-4ab8-8075-3fbe795dd89e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:21.757558 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5f7d85c0-598d-4ab8-8075-3fbe795dd89e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:21.758305 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5f7d85c0-598d-4ab8-8075-3fbe795dd89e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:21.758769 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5f7d85c0-598d-4ab8-8075-3fbe795dd89e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:21.887985 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5f7d85c0-598d-4ab8-8075-3fbe795dd89e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:15:21.896408 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5f7d85c0-598d-4ab8-8075-3fbe795dd89e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:15:21.897926 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5f7d85c0-598d-4ab8-8075-3fbe795dd89e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:15:21.899089 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-5f7d85c0-598d-4ab8-8075-3fbe795dd89e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1722 microversion: 2.20 time: 0.152771 Jul 13 21:15:21.899682 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 562/1103] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:15:21 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:15:22.083393 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-f3ad03db-cb28-4c15-a16a-2bc8e6e0a42f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:22.083981 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-f3ad03db-cb28-4c15-a16a-2bc8e6e0a42f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 22968c28-4691-4e3d-a9e9-dbc923b5fa93] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:22.091200 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f3ad03db-cb28-4c15-a16a-2bc8e6e0a42f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:22.091575 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f3ad03db-cb28-4c15-a16a-2bc8e6e0a42f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:22.092342 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f3ad03db-cb28-4c15-a16a-2bc8e6e0a42f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:22.092777 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f3ad03db-cb28-4c15-a16a-2bc8e6e0a42f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:22.176326 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.objects.instance [None req-f3ad03db-cb28-4c15-a16a-2bc8e6e0a42f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lazy-loading 'services' on Instance uuid 22968c28-4691-4e3d-a9e9-dbc923b5fa93 {{(pid=118444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:15:22.257031 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-f3ad03db-cb28-4c15-a16a-2bc8e6e0a42f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "DELETE /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93/os-volume_attachments/8c710e0e-4157-4c2e-8e96-268a509deef8" status: 202 len: 0 microversion: 2.1 time: 0.178274 Jul 13 21:15:22.257870 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 542/1104] 10.222.0.39 () {58 vars in 1415 bytes} [Wed Jul 13 21:15:22 2022] DELETE /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93/os-volume_attachments/8c710e0e-4157-4c2e-8e96-268a509deef8 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 21:15:22.266250 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-24b989a6-71ce-495e-b247-a5151000300c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:22.267758 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-24b989a6-71ce-495e-b247-a5151000300c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 22968c28-4691-4e3d-a9e9-dbc923b5fa93] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:22.273760 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-24b989a6-71ce-495e-b247-a5151000300c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:22.274204 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-24b989a6-71ce-495e-b247-a5151000300c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:22.275132 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-24b989a6-71ce-495e-b247-a5151000300c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:22.275570 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-24b989a6-71ce-495e-b247-a5151000300c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:22.304136 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-24b989a6-71ce-495e-b247-a5151000300c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041857 Jul 13 21:15:22.304681 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 563/1105] 10.222.0.39 () {58 vars in 1301 bytes} [Wed Jul 13 21:15:22 2022] GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:15:22.918189 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-530c4e73-5bc1-4881-9004-ddc9245ef794 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:22.918925 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-530c4e73-5bc1-4881-9004-ddc9245ef794 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:22.925634 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-530c4e73-5bc1-4881-9004-ddc9245ef794 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:22.926074 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-530c4e73-5bc1-4881-9004-ddc9245ef794 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:22.926864 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-530c4e73-5bc1-4881-9004-ddc9245ef794 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:22.927294 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-530c4e73-5bc1-4881-9004-ddc9245ef794 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:23.053258 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-530c4e73-5bc1-4881-9004-ddc9245ef794 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:15:23.061034 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-530c4e73-5bc1-4881-9004-ddc9245ef794 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:15:23.062510 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-530c4e73-5bc1-4881-9004-ddc9245ef794 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:15:23.063665 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-530c4e73-5bc1-4881-9004-ddc9245ef794 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1722 microversion: 2.20 time: 0.150238 Jul 13 21:15:23.064214 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 543/1106] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:15:22 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:15:23.315706 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-e2274f0c-a817-4ea5-b724-4e2495f3f7d9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:23.316616 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-e2274f0c-a817-4ea5-b724-4e2495f3f7d9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 22968c28-4691-4e3d-a9e9-dbc923b5fa93] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:23.322932 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e2274f0c-a817-4ea5-b724-4e2495f3f7d9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:23.323374 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e2274f0c-a817-4ea5-b724-4e2495f3f7d9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:23.324123 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e2274f0c-a817-4ea5-b724-4e2495f3f7d9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:23.324550 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e2274f0c-a817-4ea5-b724-4e2495f3f7d9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:23.353907 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-e2274f0c-a817-4ea5-b724-4e2495f3f7d9 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042012 Jul 13 21:15:23.354474 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 564/1107] 10.222.0.39 () {58 vars in 1301 bytes} [Wed Jul 13 21:15:23 2022] GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:15:24.081771 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-da7b1800-97d3-433c-ab5a-7c75af6147e8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:24.082406 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-da7b1800-97d3-433c-ab5a-7c75af6147e8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:24.089025 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-da7b1800-97d3-433c-ab5a-7c75af6147e8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:24.089470 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-da7b1800-97d3-433c-ab5a-7c75af6147e8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:24.090222 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-da7b1800-97d3-433c-ab5a-7c75af6147e8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:24.090711 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-da7b1800-97d3-433c-ab5a-7c75af6147e8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:24.313792 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-da7b1800-97d3-433c-ab5a-7c75af6147e8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:15:24.323241 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-da7b1800-97d3-433c-ab5a-7c75af6147e8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:15:24.324749 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-da7b1800-97d3-433c-ab5a-7c75af6147e8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0884a33a47e448e7826f257880a28964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43ca8a5c9f2494fbb9c5c5509c5c79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:15:24.325925 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-da7b1800-97d3-433c-ab5a-7c75af6147e8 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 200 len: 1722 microversion: 2.20 time: 0.248031 Jul 13 21:15:24.326489 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 544/1108] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:15:24 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 21:15:24.372919 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-f49062f9-581e-4dca-b3ce-08c8ec885f81 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:24.376388 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-f49062f9-581e-4dca-b3ce-08c8ec885f81 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 22968c28-4691-4e3d-a9e9-dbc923b5fa93] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:24.383160 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f49062f9-581e-4dca-b3ce-08c8ec885f81 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:24.383707 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f49062f9-581e-4dca-b3ce-08c8ec885f81 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:24.384812 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f49062f9-581e-4dca-b3ce-08c8ec885f81 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:24.385314 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f49062f9-581e-4dca-b3ce-08c8ec885f81 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:24.418977 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-f49062f9-581e-4dca-b3ce-08c8ec885f81 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056663 Jul 13 21:15:24.419725 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 565/1109] 10.222.0.39 () {58 vars in 1301 bytes} [Wed Jul 13 21:15:24 2022] GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:15:24.811439 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-f8efe11a-9908-4929-8b36-40d81abd7f15 req-c72c80e0-a85e-40bf-935b-283a921439fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49b390c-173a-4b3b-b9ac-dc1afce64811", "name": "network-vif-deleted", "tag": "6f0e0bf0-9555-4b8f-aeaf-d1acda127705"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:15:24.819652 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-f8efe11a-9908-4929-8b36-40d81abd7f15 req-c72c80e0-a85e-40bf-935b-283a921439fa service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:24.820119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-f8efe11a-9908-4929-8b36-40d81abd7f15 req-c72c80e0-a85e-40bf-935b-283a921439fa service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:24.835818 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-f8efe11a-9908-4929-8b36-40d81abd7f15 req-c72c80e0-a85e-40bf-935b-283a921439fa service nova] Creating event network-vif-deleted:6f0e0bf0-9555-4b8f-aeaf-d1acda127705 for instance d49b390c-173a-4b3b-b9ac-dc1afce64811 on hv-cinder-79987 Jul 13 21:15:24.843272 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-f8efe11a-9908-4929-8b36-40d81abd7f15 req-c72c80e0-a85e-40bf-935b-283a921439fa service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035260 Jul 13 21:15:24.845283 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 545/1110] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:15:25.344513 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-a66f8d29-6d4c-4dbb-a5c3-d40e3c8bf9eb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:25.345235 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-a66f8d29-6d4c-4dbb-a5c3-d40e3c8bf9eb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:25.351705 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a66f8d29-6d4c-4dbb-a5c3-d40e3c8bf9eb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:25.352472 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a66f8d29-6d4c-4dbb-a5c3-d40e3c8bf9eb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:25.353415 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a66f8d29-6d4c-4dbb-a5c3-d40e3c8bf9eb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:25.353875 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a66f8d29-6d4c-4dbb-a5c3-d40e3c8bf9eb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:25.372080 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.wsgi [None req-a66f8d29-6d4c-4dbb-a5c3-d40e3c8bf9eb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] HTTP exception thrown: Instance d49b390c-173a-4b3b-b9ac-dc1afce64811 could not be found. Jul 13 21:15:25.373715 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-a66f8d29-6d4c-4dbb-a5c3-d40e3c8bf9eb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Request method failure captured: Jul 13 21:15:25.373715 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: request: GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 HTTP/1.1 Jul 13 21:15:25.373715 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept: application/json Jul 13 21:15:25.373715 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept-Encoding: identity Jul 13 21:15:25.373715 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Connection: close Jul 13 21:15:25.373715 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Length: 0 Jul 13 21:15:25.373715 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Type: application/json Jul 13 21:15:25.373715 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Host: 10.222.0.39 Jul 13 21:15:25.373715 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Openstack-System-Scope: None Jul 13 21:15:25.373715 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: User-Agent: python-urllib3/1.26.9 Jul 13 21:15:25.373715 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Auth-Token: gAAAAABizzNvSRu2b2ZpqIR4KbSCswRIDfFdSsj05xGSoupc9NAJHPqB6oS742DGj4-GuWgK-i-D6b8poG5uP5GlFTjUKIltlWKbOQCr1styYXhRbx3uotGCYoUsbLOHE_SuQ1w5LXS67zCuZB2MDNSeGT3uNHuiqy_zDIgYzHPQbPFUM4hUkOs Jul 13 21:15:25.373715 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Id: None Jul 13 21:15:25.373715 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Name: None Jul 13 21:15:25.373715 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Identity-Status: Confirmed Jul 13 21:15:25.373715 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Is-Admin-Project: True Jul 13 21:15:25.373715 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Openstack-Nova-Api-Version: 2.20 Jul 13 21:15:25.373715 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Id: default Jul 13 21:15:25.373715 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Name: Default Jul 13 21:15:25.373715 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Id: e43ca8a5c9f2494fbb9c5c5509c5c79b Jul 13 21:15:25.373715 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2097802904 Jul 13 21:15:25.373715 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Role: member,reader Jul 13 21:15:25.373715 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Roles: member,reader Jul 13 21:15:25.376514 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e43ca8a5c9f2494fbb9c5c5509c5c79b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e43ca8a5c9f2494fbb9c5c5509c5c79b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e43ca8a5c9f2494fbb9c5c5509c5c79b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e43ca8a5c9f2494fbb9c5c5509c5c79b"}]}] Jul 13 21:15:25.376514 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2097802904 Jul 13 21:15:25.376514 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Id: e43ca8a5c9f2494fbb9c5c5509c5c79b Jul 13 21:15:25.376514 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2097802904 Jul 13 21:15:25.376514 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User: tempest-AttachVolumeShelveTestJSON-2097802904-project Jul 13 21:15:25.376514 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Id: default Jul 13 21:15:25.376514 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Name: Default Jul 13 21:15:25.376514 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Id: 0884a33a47e448e7826f257880a28964 Jul 13 21:15:25.376514 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2097802904-project Jul 13 21:15:25.376514 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: method: > Jul 13 21:15:25.376514 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: exception: Instance d49b390c-173a-4b3b-b9ac-dc1afce64811 could not be found. Jul 13 21:15:25.376514 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: action_args: {'id': 'd49b390c-173a-4b3b-b9ac-dc1afce64811'} Jul 13 21:15:25.377426 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:15:25.377426 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:25.377426 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:15:25.377426 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:15:25.377426 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:15:25.377426 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:15:25.377426 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:15:25.377426 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:15:25.377426 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:15:25.377426 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:15:25.377426 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d49b390c-173a-4b3b-b9ac-dc1afce64811 could not be found. Jul 13 21:15:25.377426 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:25.377426 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:25.377426 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:25.377426 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:25.377426 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:25.377426 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:25.377426 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:15:25.377426 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:15:25.377426 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:15:25.379029 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:15:25.379029 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 21:15:25.379029 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 21:15:25.379029 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:15:25.379029 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:15:25.379029 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:15:25.379029 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:15:25.379029 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d49b390c-173a-4b3b-b9ac-dc1afce64811 could not be found. Jul 13 21:15:25.379029 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:25.379029 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:25.379029 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:25.379029 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:25.379029 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:25.379029 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:25.379029 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:15:25.379029 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:15:25.379029 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d49b390c-173a-4b3b-b9ac-dc1afce64811 could not be found. Jul 13 21:15:25.379029 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:25.380877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-a66f8d29-6d4c-4dbb-a5c3-d40e3c8bf9eb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Returning 404 to user: Instance d49b390c-173a-4b3b-b9ac-dc1afce64811 could not be found. {{(pid=118445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:15:25.380877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-a66f8d29-6d4c-4dbb-a5c3-d40e3c8bf9eb tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 404 len: 111 microversion: 2.20 time: 0.034767 Jul 13 21:15:25.380877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 566/1111] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:15:25 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 13 21:15:25.386514 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-1dc66dd1-15ad-4fb2-9e84-db126f092978 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '.version_select at 0x7f96e88dd8b0>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:25.406502 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-1dc66dd1-15ad-4fb2-9e84-db126f092978 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-385341587" status: 204 len: 0 microversion: 2.20 time: 0.024768 Jul 13 21:15:25.407438 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 546/1112] 10.222.0.39 () {60 vars in 1258 bytes} [Wed Jul 13 21:15:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-385341587 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 13 21:15:25.434893 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-57941c73-2479-41a2-8bf6-8029661b70ce tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:25.436077 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-57941c73-2479-41a2-8bf6-8029661b70ce tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 22968c28-4691-4e3d-a9e9-dbc923b5fa93] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:25.445766 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-57941c73-2479-41a2-8bf6-8029661b70ce tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:25.446394 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-57941c73-2479-41a2-8bf6-8029661b70ce tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:25.447628 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-57941c73-2479-41a2-8bf6-8029661b70ce tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:25.448417 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-57941c73-2479-41a2-8bf6-8029661b70ce tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:25.485889 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-57941c73-2479-41a2-8bf6-8029661b70ce tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056890 Jul 13 21:15:25.491271 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 567/1113] 10.222.0.39 () {58 vars in 1301 bytes} [Wed Jul 13 21:15:25 2022] GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 13 21:15:25.549847 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-e610a269-6678-4b49-ab56-c85c2291716c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:25.550463 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-e610a269-6678-4b49-ab56-c85c2291716c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 22968c28-4691-4e3d-a9e9-dbc923b5fa93] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:25.556848 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e610a269-6678-4b49-ab56-c85c2291716c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:25.557305 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e610a269-6678-4b49-ab56-c85c2291716c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:25.558071 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e610a269-6678-4b49-ab56-c85c2291716c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:25.558507 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e610a269-6678-4b49-ab56-c85c2291716c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:25.592155 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-e610a269-6678-4b49-ab56-c85c2291716c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 22968c28-4691-4e3d-a9e9-dbc923b5fa93] Going to try to terminate instance {{(pid=118444) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 21:15:25.690885 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-e610a269-6678-4b49-ab56-c85c2291716c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "DELETE /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93" status: 204 len: 0 microversion: 2.1 time: 0.145129 Jul 13 21:15:25.694921 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 547/1114] 10.222.0.39 () {58 vars in 1238 bytes} [Wed Jul 13 21:15:25 2022] DELETE /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 21:15:25.701938 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-a8e792d0-866d-4b30-9708-0f6c0b12559c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:25.702444 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-a8e792d0-866d-4b30-9708-0f6c0b12559c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 22968c28-4691-4e3d-a9e9-dbc923b5fa93] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:25.709223 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a8e792d0-866d-4b30-9708-0f6c0b12559c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:25.709803 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a8e792d0-866d-4b30-9708-0f6c0b12559c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:25.710927 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a8e792d0-866d-4b30-9708-0f6c0b12559c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:25.711513 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a8e792d0-866d-4b30-9708-0f6c0b12559c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:25.850453 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-a8e792d0-866d-4b30-9708-0f6c0b12559c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:15:25.858016 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-a8e792d0-866d-4b30-9708-0f6c0b12559c tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93" status: 200 len: 1681 microversion: 2.1 time: 0.161959 Jul 13 21:15:25.858595 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 568/1115] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:15:25 2022] GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:15:26.877351 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-43e36ab9-6847-45b4-9c9a-cb36e6b70ec7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:26.878050 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-43e36ab9-6847-45b4-9c9a-cb36e6b70ec7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 22968c28-4691-4e3d-a9e9-dbc923b5fa93] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:26.884711 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-43e36ab9-6847-45b4-9c9a-cb36e6b70ec7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:26.885162 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-43e36ab9-6847-45b4-9c9a-cb36e6b70ec7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:26.885918 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-43e36ab9-6847-45b4-9c9a-cb36e6b70ec7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:26.886355 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-43e36ab9-6847-45b4-9c9a-cb36e6b70ec7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:27.011383 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-43e36ab9-6847-45b4-9c9a-cb36e6b70ec7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:15:27.018810 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-43e36ab9-6847-45b4-9c9a-cb36e6b70ec7 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93" status: 200 len: 1681 microversion: 2.1 time: 0.146312 Jul 13 21:15:27.019389 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 548/1116] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:15:26 2022] GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:15:27.217398 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-00d2a5d7-7289-4b4d-a4ff-59374b64829e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:27.217882 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-00d2a5d7-7289-4b4d-a4ff-59374b64829e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:27.224940 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-00d2a5d7-7289-4b4d-a4ff-59374b64829e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:27.225387 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-00d2a5d7-7289-4b4d-a4ff-59374b64829e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:27.226146 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-00d2a5d7-7289-4b4d-a4ff-59374b64829e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:27.226578 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-00d2a5d7-7289-4b4d-a4ff-59374b64829e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:27.240316 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.wsgi [None req-00d2a5d7-7289-4b4d-a4ff-59374b64829e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] HTTP exception thrown: Instance d49b390c-173a-4b3b-b9ac-dc1afce64811 could not be found. Jul 13 21:15:27.241862 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-00d2a5d7-7289-4b4d-a4ff-59374b64829e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Request method failure captured: Jul 13 21:15:27.241862 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: request: DELETE /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 HTTP/1.1 Jul 13 21:15:27.241862 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept: application/json Jul 13 21:15:27.241862 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept-Encoding: identity Jul 13 21:15:27.241862 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Connection: close Jul 13 21:15:27.241862 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Length: 0 Jul 13 21:15:27.241862 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Type: application/json Jul 13 21:15:27.241862 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Host: 10.222.0.39 Jul 13 21:15:27.241862 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Openstack-System-Scope: None Jul 13 21:15:27.241862 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: User-Agent: python-urllib3/1.26.9 Jul 13 21:15:27.241862 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Auth-Token: gAAAAABizzNvSRu2b2ZpqIR4KbSCswRIDfFdSsj05xGSoupc9NAJHPqB6oS742DGj4-GuWgK-i-D6b8poG5uP5GlFTjUKIltlWKbOQCr1styYXhRbx3uotGCYoUsbLOHE_SuQ1w5LXS67zCuZB2MDNSeGT3uNHuiqy_zDIgYzHPQbPFUM4hUkOs Jul 13 21:15:27.241862 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Id: None Jul 13 21:15:27.241862 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Name: None Jul 13 21:15:27.241862 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Identity-Status: Confirmed Jul 13 21:15:27.241862 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Is-Admin-Project: True Jul 13 21:15:27.241862 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Openstack-Nova-Api-Version: 2.20 Jul 13 21:15:27.241862 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Id: default Jul 13 21:15:27.241862 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Name: Default Jul 13 21:15:27.241862 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Id: e43ca8a5c9f2494fbb9c5c5509c5c79b Jul 13 21:15:27.241862 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2097802904 Jul 13 21:15:27.241862 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Role: member,reader Jul 13 21:15:27.241862 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Roles: member,reader Jul 13 21:15:27.243516 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e43ca8a5c9f2494fbb9c5c5509c5c79b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e43ca8a5c9f2494fbb9c5c5509c5c79b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e43ca8a5c9f2494fbb9c5c5509c5c79b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e43ca8a5c9f2494fbb9c5c5509c5c79b"}]}] Jul 13 21:15:27.243516 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2097802904 Jul 13 21:15:27.243516 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Id: e43ca8a5c9f2494fbb9c5c5509c5c79b Jul 13 21:15:27.243516 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2097802904 Jul 13 21:15:27.243516 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User: tempest-AttachVolumeShelveTestJSON-2097802904-project Jul 13 21:15:27.243516 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Id: default Jul 13 21:15:27.243516 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Name: Default Jul 13 21:15:27.243516 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Id: 0884a33a47e448e7826f257880a28964 Jul 13 21:15:27.243516 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2097802904-project Jul 13 21:15:27.243516 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: method: > Jul 13 21:15:27.243516 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: exception: Instance d49b390c-173a-4b3b-b9ac-dc1afce64811 could not be found. Jul 13 21:15:27.243516 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: action_args: {'id': 'd49b390c-173a-4b3b-b9ac-dc1afce64811'} Jul 13 21:15:27.244384 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:15:27.244384 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:27.244384 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:15:27.244384 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:15:27.244384 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:15:27.244384 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:15:27.244384 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:15:27.244384 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:15:27.244384 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:15:27.244384 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:15:27.244384 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d49b390c-173a-4b3b-b9ac-dc1afce64811 could not be found. Jul 13 21:15:27.244384 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:27.244384 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:27.244384 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:27.244384 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:27.244384 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:27.244384 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:27.244384 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:15:27.244384 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:15:27.244384 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:15:27.245826 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:15:27.245826 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 13 21:15:27.245826 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 13 21:15:27.245826 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 13 21:15:27.245826 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 13 21:15:27.245826 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:15:27.245826 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:15:27.245826 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:15:27.245826 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:15:27.245826 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d49b390c-173a-4b3b-b9ac-dc1afce64811 could not be found. Jul 13 21:15:27.245826 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:27.245826 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:27.245826 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:27.245826 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:27.245826 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:27.245826 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:27.245826 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:15:27.245826 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:15:27.245826 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d49b390c-173a-4b3b-b9ac-dc1afce64811 could not be found. Jul 13 21:15:27.245826 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:27.247366 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-00d2a5d7-7289-4b4d-a4ff-59374b64829e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Returning 404 to user: Instance d49b390c-173a-4b3b-b9ac-dc1afce64811 could not be found. {{(pid=118445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:15:27.247366 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-00d2a5d7-7289-4b4d-a4ff-59374b64829e tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 404 len: 111 microversion: 2.20 time: 0.029653 Jul 13 21:15:27.247366 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 569/1117] 10.222.0.39 () {60 vars in 1279 bytes} [Wed Jul 13 21:15:27 2022] DELETE /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 13 21:15:27.251573 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-81d092c1-066d-463f-8d84-351f79db43d0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:27.252178 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-81d092c1-066d-463f-8d84-351f79db43d0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: d49b390c-173a-4b3b-b9ac-dc1afce64811] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:27.258047 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-81d092c1-066d-463f-8d84-351f79db43d0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:27.258496 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-81d092c1-066d-463f-8d84-351f79db43d0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:27.259540 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-81d092c1-066d-463f-8d84-351f79db43d0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:27.259975 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-81d092c1-066d-463f-8d84-351f79db43d0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:27.273024 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.wsgi [None req-81d092c1-066d-463f-8d84-351f79db43d0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] HTTP exception thrown: Instance d49b390c-173a-4b3b-b9ac-dc1afce64811 could not be found. Jul 13 21:15:27.274686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-81d092c1-066d-463f-8d84-351f79db43d0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Request method failure captured: Jul 13 21:15:27.274686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: request: GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 HTTP/1.1 Jul 13 21:15:27.274686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept: application/json Jul 13 21:15:27.274686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept-Encoding: identity Jul 13 21:15:27.274686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Connection: close Jul 13 21:15:27.274686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Length: 0 Jul 13 21:15:27.274686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Type: application/json Jul 13 21:15:27.274686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Host: 10.222.0.39 Jul 13 21:15:27.274686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Openstack-System-Scope: None Jul 13 21:15:27.274686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: User-Agent: python-urllib3/1.26.9 Jul 13 21:15:27.274686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Auth-Token: gAAAAABizzNvSRu2b2ZpqIR4KbSCswRIDfFdSsj05xGSoupc9NAJHPqB6oS742DGj4-GuWgK-i-D6b8poG5uP5GlFTjUKIltlWKbOQCr1styYXhRbx3uotGCYoUsbLOHE_SuQ1w5LXS67zCuZB2MDNSeGT3uNHuiqy_zDIgYzHPQbPFUM4hUkOs Jul 13 21:15:27.274686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Id: None Jul 13 21:15:27.274686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Name: None Jul 13 21:15:27.274686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Identity-Status: Confirmed Jul 13 21:15:27.274686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Is-Admin-Project: True Jul 13 21:15:27.274686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Openstack-Nova-Api-Version: 2.20 Jul 13 21:15:27.274686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Id: default Jul 13 21:15:27.274686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Name: Default Jul 13 21:15:27.274686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Id: e43ca8a5c9f2494fbb9c5c5509c5c79b Jul 13 21:15:27.274686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2097802904 Jul 13 21:15:27.274686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Role: member,reader Jul 13 21:15:27.274686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Roles: member,reader Jul 13 21:15:27.276295 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e43ca8a5c9f2494fbb9c5c5509c5c79b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e43ca8a5c9f2494fbb9c5c5509c5c79b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e43ca8a5c9f2494fbb9c5c5509c5c79b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e43ca8a5c9f2494fbb9c5c5509c5c79b"}]}] Jul 13 21:15:27.276295 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2097802904 Jul 13 21:15:27.276295 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Id: e43ca8a5c9f2494fbb9c5c5509c5c79b Jul 13 21:15:27.276295 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2097802904 Jul 13 21:15:27.276295 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User: tempest-AttachVolumeShelveTestJSON-2097802904-project Jul 13 21:15:27.276295 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Id: default Jul 13 21:15:27.276295 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Name: Default Jul 13 21:15:27.276295 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Id: 0884a33a47e448e7826f257880a28964 Jul 13 21:15:27.276295 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2097802904-project Jul 13 21:15:27.276295 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: method: > Jul 13 21:15:27.276295 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: exception: Instance d49b390c-173a-4b3b-b9ac-dc1afce64811 could not be found. Jul 13 21:15:27.276295 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: action_args: {'id': 'd49b390c-173a-4b3b-b9ac-dc1afce64811'} Jul 13 21:15:27.277182 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:15:27.277182 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:27.277182 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:15:27.277182 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:15:27.277182 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:15:27.277182 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:15:27.277182 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:15:27.277182 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:15:27.277182 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:15:27.277182 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:15:27.277182 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d49b390c-173a-4b3b-b9ac-dc1afce64811 could not be found. Jul 13 21:15:27.277182 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:27.277182 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:27.277182 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:27.277182 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:27.277182 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:27.277182 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:27.277182 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:15:27.277182 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:15:27.277182 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:15:27.278680 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:15:27.278680 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 21:15:27.278680 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 21:15:27.278680 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:15:27.278680 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:15:27.278680 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:15:27.278680 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:15:27.278680 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d49b390c-173a-4b3b-b9ac-dc1afce64811 could not be found. Jul 13 21:15:27.278680 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:27.278680 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:27.278680 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:27.278680 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:27.278680 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:27.278680 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:27.278680 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:15:27.278680 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:15:27.278680 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d49b390c-173a-4b3b-b9ac-dc1afce64811 could not be found. Jul 13 21:15:27.278680 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:27.280554 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-81d092c1-066d-463f-8d84-351f79db43d0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Returning 404 to user: Instance d49b390c-173a-4b3b-b9ac-dc1afce64811 could not be found. {{(pid=118444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:15:27.280554 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-81d092c1-066d-463f-8d84-351f79db43d0 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811" status: 404 len: 111 microversion: 2.20 time: 0.028354 Jul 13 21:15:27.280554 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 549/1118] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:15:27 2022] GET /compute/v2.1/servers/d49b390c-173a-4b3b-b9ac-dc1afce64811 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 13 21:15:28.036017 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-8977e44d-9a75-4174-84da-16696fadddd5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:28.036532 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8977e44d-9a75-4174-84da-16696fadddd5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 22968c28-4691-4e3d-a9e9-dbc923b5fa93] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:28.042825 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8977e44d-9a75-4174-84da-16696fadddd5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:28.043272 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8977e44d-9a75-4174-84da-16696fadddd5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:28.044034 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8977e44d-9a75-4174-84da-16696fadddd5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:28.044469 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8977e44d-9a75-4174-84da-16696fadddd5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:28.177928 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8977e44d-9a75-4174-84da-16696fadddd5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cab6f67cd34c46886d036ba170331e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2703a8b75043e0ab0656482fa9ddeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:15:28.187551 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-8977e44d-9a75-4174-84da-16696fadddd5 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93" status: 200 len: 1681 microversion: 2.1 time: 0.155366 Jul 13 21:15:28.188790 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 570/1119] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:15:28 2022] GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:15:28.411928 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-d3e037e0-1f85-4d60-9350-1b05a2e56809 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:28.412425 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-d3e037e0-1f85-4d60-9350-1b05a2e56809 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:28.418894 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d3e037e0-1f85-4d60-9350-1b05a2e56809 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:28.419352 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d3e037e0-1f85-4d60-9350-1b05a2e56809 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:28.420117 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d3e037e0-1f85-4d60-9350-1b05a2e56809 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:28.420567 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d3e037e0-1f85-4d60-9350-1b05a2e56809 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:28.436784 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.wsgi [None req-d3e037e0-1f85-4d60-9350-1b05a2e56809 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] HTTP exception thrown: Instance 12316d28-2975-4c1e-b05b-82a3253bb35f could not be found. Jul 13 21:15:28.438940 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-d3e037e0-1f85-4d60-9350-1b05a2e56809 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Request method failure captured: Jul 13 21:15:28.438940 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: request: DELETE /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f HTTP/1.1 Jul 13 21:15:28.438940 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept: application/json Jul 13 21:15:28.438940 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept-Encoding: identity Jul 13 21:15:28.438940 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Connection: close Jul 13 21:15:28.438940 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Length: 0 Jul 13 21:15:28.438940 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Type: application/json Jul 13 21:15:28.438940 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Host: 10.222.0.39 Jul 13 21:15:28.438940 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Openstack-System-Scope: None Jul 13 21:15:28.438940 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: User-Agent: python-urllib3/1.26.9 Jul 13 21:15:28.438940 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Auth-Token: gAAAAABizzNvSRu2b2ZpqIR4KbSCswRIDfFdSsj05xGSoupc9NAJHPqB6oS742DGj4-GuWgK-i-D6b8poG5uP5GlFTjUKIltlWKbOQCr1styYXhRbx3uotGCYoUsbLOHE_SuQ1w5LXS67zCuZB2MDNSeGT3uNHuiqy_zDIgYzHPQbPFUM4hUkOs Jul 13 21:15:28.438940 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Id: None Jul 13 21:15:28.438940 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Name: None Jul 13 21:15:28.438940 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Identity-Status: Confirmed Jul 13 21:15:28.438940 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Is-Admin-Project: True Jul 13 21:15:28.438940 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Openstack-Nova-Api-Version: 2.20 Jul 13 21:15:28.438940 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Id: default Jul 13 21:15:28.438940 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Name: Default Jul 13 21:15:28.438940 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Id: e43ca8a5c9f2494fbb9c5c5509c5c79b Jul 13 21:15:28.438940 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2097802904 Jul 13 21:15:28.438940 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Role: member,reader Jul 13 21:15:28.438940 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Roles: member,reader Jul 13 21:15:28.440672 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e43ca8a5c9f2494fbb9c5c5509c5c79b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e43ca8a5c9f2494fbb9c5c5509c5c79b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e43ca8a5c9f2494fbb9c5c5509c5c79b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e43ca8a5c9f2494fbb9c5c5509c5c79b"}]}] Jul 13 21:15:28.440672 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2097802904 Jul 13 21:15:28.440672 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Id: e43ca8a5c9f2494fbb9c5c5509c5c79b Jul 13 21:15:28.440672 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2097802904 Jul 13 21:15:28.440672 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User: tempest-AttachVolumeShelveTestJSON-2097802904-project Jul 13 21:15:28.440672 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Id: default Jul 13 21:15:28.440672 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Name: Default Jul 13 21:15:28.440672 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Id: 0884a33a47e448e7826f257880a28964 Jul 13 21:15:28.440672 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2097802904-project Jul 13 21:15:28.440672 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: method: > Jul 13 21:15:28.440672 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: exception: Instance 12316d28-2975-4c1e-b05b-82a3253bb35f could not be found. Jul 13 21:15:28.440672 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: action_args: {'id': '12316d28-2975-4c1e-b05b-82a3253bb35f'} Jul 13 21:15:28.444746 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:15:28.444746 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:28.444746 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:15:28.444746 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:15:28.444746 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:15:28.444746 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:15:28.444746 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:15:28.444746 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:15:28.444746 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:15:28.444746 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:15:28.444746 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12316d28-2975-4c1e-b05b-82a3253bb35f could not be found. Jul 13 21:15:28.444746 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:28.444746 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:28.444746 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:28.444746 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:28.444746 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:28.444746 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:28.444746 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:15:28.444746 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:15:28.444746 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:15:28.446216 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:15:28.446216 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 13 21:15:28.446216 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 13 21:15:28.446216 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 13 21:15:28.446216 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 13 21:15:28.446216 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:15:28.446216 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:15:28.446216 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:15:28.446216 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:15:28.446216 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12316d28-2975-4c1e-b05b-82a3253bb35f could not be found. Jul 13 21:15:28.446216 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:28.446216 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:28.446216 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:28.446216 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:28.446216 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:28.446216 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:28.446216 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:15:28.446216 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:15:28.446216 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12316d28-2975-4c1e-b05b-82a3253bb35f could not be found. Jul 13 21:15:28.446216 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:28.447641 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-d3e037e0-1f85-4d60-9350-1b05a2e56809 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Returning 404 to user: Instance 12316d28-2975-4c1e-b05b-82a3253bb35f could not be found. {{(pid=118444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:15:28.447641 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-d3e037e0-1f85-4d60-9350-1b05a2e56809 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "DELETE /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 404 len: 111 microversion: 2.20 time: 0.032411 Jul 13 21:15:28.447641 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 550/1120] 10.222.0.39 () {60 vars in 1279 bytes} [Wed Jul 13 21:15:28 2022] DELETE /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 13 21:15:28.448871 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-aede12c5-05c2-4689-babc-9210651f98d2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:28.449466 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-aede12c5-05c2-4689-babc-9210651f98d2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] [instance: 12316d28-2975-4c1e-b05b-82a3253bb35f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:28.456633 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-aede12c5-05c2-4689-babc-9210651f98d2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:28.456904 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-aede12c5-05c2-4689-babc-9210651f98d2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:28.457669 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-aede12c5-05c2-4689-babc-9210651f98d2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:28.458103 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-aede12c5-05c2-4689-babc-9210651f98d2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:28.472865 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.wsgi [None req-aede12c5-05c2-4689-babc-9210651f98d2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] HTTP exception thrown: Instance 12316d28-2975-4c1e-b05b-82a3253bb35f could not be found. Jul 13 21:15:28.474600 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-aede12c5-05c2-4689-babc-9210651f98d2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Request method failure captured: Jul 13 21:15:28.474600 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: request: GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f HTTP/1.1 Jul 13 21:15:28.474600 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept: application/json Jul 13 21:15:28.474600 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept-Encoding: identity Jul 13 21:15:28.474600 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Connection: close Jul 13 21:15:28.474600 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Length: 0 Jul 13 21:15:28.474600 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Type: application/json Jul 13 21:15:28.474600 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Host: 10.222.0.39 Jul 13 21:15:28.474600 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Openstack-System-Scope: None Jul 13 21:15:28.474600 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: User-Agent: python-urllib3/1.26.9 Jul 13 21:15:28.474600 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Auth-Token: gAAAAABizzNvSRu2b2ZpqIR4KbSCswRIDfFdSsj05xGSoupc9NAJHPqB6oS742DGj4-GuWgK-i-D6b8poG5uP5GlFTjUKIltlWKbOQCr1styYXhRbx3uotGCYoUsbLOHE_SuQ1w5LXS67zCuZB2MDNSeGT3uNHuiqy_zDIgYzHPQbPFUM4hUkOs Jul 13 21:15:28.474600 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Id: None Jul 13 21:15:28.474600 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Name: None Jul 13 21:15:28.474600 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Identity-Status: Confirmed Jul 13 21:15:28.474600 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Is-Admin-Project: True Jul 13 21:15:28.474600 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Openstack-Nova-Api-Version: 2.20 Jul 13 21:15:28.474600 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Id: default Jul 13 21:15:28.474600 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Name: Default Jul 13 21:15:28.474600 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Id: e43ca8a5c9f2494fbb9c5c5509c5c79b Jul 13 21:15:28.474600 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2097802904 Jul 13 21:15:28.474600 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Role: member,reader Jul 13 21:15:28.474600 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Roles: member,reader Jul 13 21:15:28.476219 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e43ca8a5c9f2494fbb9c5c5509c5c79b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e43ca8a5c9f2494fbb9c5c5509c5c79b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e43ca8a5c9f2494fbb9c5c5509c5c79b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e43ca8a5c9f2494fbb9c5c5509c5c79b"}]}] Jul 13 21:15:28.476219 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2097802904 Jul 13 21:15:28.476219 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Id: e43ca8a5c9f2494fbb9c5c5509c5c79b Jul 13 21:15:28.476219 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2097802904 Jul 13 21:15:28.476219 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User: tempest-AttachVolumeShelveTestJSON-2097802904-project Jul 13 21:15:28.476219 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Id: default Jul 13 21:15:28.476219 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Name: Default Jul 13 21:15:28.476219 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Id: 0884a33a47e448e7826f257880a28964 Jul 13 21:15:28.476219 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2097802904-project Jul 13 21:15:28.476219 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: method: > Jul 13 21:15:28.476219 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: exception: Instance 12316d28-2975-4c1e-b05b-82a3253bb35f could not be found. Jul 13 21:15:28.476219 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: action_args: {'id': '12316d28-2975-4c1e-b05b-82a3253bb35f'} Jul 13 21:15:28.476964 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:15:28.476964 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:28.476964 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:15:28.476964 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:15:28.476964 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:15:28.476964 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:15:28.476964 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:15:28.476964 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:15:28.476964 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:15:28.476964 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:15:28.476964 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12316d28-2975-4c1e-b05b-82a3253bb35f could not be found. Jul 13 21:15:28.476964 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:28.476964 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:28.476964 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:28.476964 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:28.476964 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:28.476964 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:28.476964 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:15:28.476964 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:15:28.476964 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:15:28.478317 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:15:28.478317 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 21:15:28.478317 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 21:15:28.478317 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:15:28.478317 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:15:28.478317 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:15:28.478317 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:15:28.478317 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12316d28-2975-4c1e-b05b-82a3253bb35f could not be found. Jul 13 21:15:28.478317 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:28.478317 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:28.478317 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:28.478317 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:28.478317 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:28.478317 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:28.478317 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:15:28.478317 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:15:28.478317 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12316d28-2975-4c1e-b05b-82a3253bb35f could not be found. Jul 13 21:15:28.478317 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:28.480261 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-aede12c5-05c2-4689-babc-9210651f98d2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] Returning 404 to user: Instance 12316d28-2975-4c1e-b05b-82a3253bb35f could not be found. {{(pid=118445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:15:28.481409 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-aede12c5-05c2-4689-babc-9210651f98d2 tempest-AttachVolumeShelveTestJSON-2097802904 tempest-AttachVolumeShelveTestJSON-2097802904-project] 10.222.0.39 "GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f" status: 404 len: 111 microversion: 2.20 time: 0.036484 Jul 13 21:15:28.482429 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 571/1121] 10.222.0.39 () {60 vars in 1276 bytes} [Wed Jul 13 21:15:28 2022] GET /compute/v2.1/servers/12316d28-2975-4c1e-b05b-82a3253bb35f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 13 21:15:28.510381 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-38abc61c-a1b4-460d-b113-d8788251409b req-1c3c8216-1a14-453a-9181-72d4a7729dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22968c28-4691-4e3d-a9e9-dbc923b5fa93", "name": "network-vif-deleted", "tag": "821c0e73-63a8-4070-abbf-6531a9c1abc6"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:15:28.523443 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-38abc61c-a1b4-460d-b113-d8788251409b req-1c3c8216-1a14-453a-9181-72d4a7729dc0 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:28.529034 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-38abc61c-a1b4-460d-b113-d8788251409b req-1c3c8216-1a14-453a-9181-72d4a7729dc0 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:28.541157 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-38abc61c-a1b4-460d-b113-d8788251409b req-1c3c8216-1a14-453a-9181-72d4a7729dc0 service nova] Creating event network-vif-deleted:821c0e73-63a8-4070-abbf-6531a9c1abc6 for instance 22968c28-4691-4e3d-a9e9-dbc923b5fa93 on hv-cinder-79987 Jul 13 21:15:28.551436 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-38abc61c-a1b4-460d-b113-d8788251409b req-1c3c8216-1a14-453a-9181-72d4a7729dc0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046038 Jul 13 21:15:28.554955 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 551/1122] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:15:29.206170 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-24aa8068-4138-4829-8755-42a0a738bc4d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:29.206845 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-24aa8068-4138-4829-8755-42a0a738bc4d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 22968c28-4691-4e3d-a9e9-dbc923b5fa93] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:29.217724 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-24aa8068-4138-4829-8755-42a0a738bc4d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:29.218468 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-24aa8068-4138-4829-8755-42a0a738bc4d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:29.220027 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-24aa8068-4138-4829-8755-42a0a738bc4d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:29.220772 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-24aa8068-4138-4829-8755-42a0a738bc4d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:29.237905 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.wsgi [None req-24aa8068-4138-4829-8755-42a0a738bc4d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] HTTP exception thrown: Instance 22968c28-4691-4e3d-a9e9-dbc923b5fa93 could not be found. Jul 13 21:15:29.240285 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-24aa8068-4138-4829-8755-42a0a738bc4d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Request method failure captured: Jul 13 21:15:29.240285 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: request: GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93 HTTP/1.1 Jul 13 21:15:29.240285 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept: application/json Jul 13 21:15:29.240285 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept-Encoding: identity Jul 13 21:15:29.240285 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Connection: close Jul 13 21:15:29.240285 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Length: 0 Jul 13 21:15:29.240285 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Type: application/json Jul 13 21:15:29.240285 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Host: 10.222.0.39 Jul 13 21:15:29.240285 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Openstack-System-Scope: None Jul 13 21:15:29.240285 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: User-Agent: python-urllib3/1.26.9 Jul 13 21:15:29.240285 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Auth-Token: gAAAAABizzNqbt1i7chwFPcQAba6b9dk7TD8_G2l_XT7jQopf9IFAZNKmztmBJ4IISK_ds_GpyDLtbYZUS7JtctAPU-Tk1Sa5a4_tbywXB6GjEvdott7LmC4oiwINlLKkOc-EI-NfdeC0sCeq7QrJd1h1pR8691UeSBeFVmfqq10_09s26cRblc Jul 13 21:15:29.240285 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Id: None Jul 13 21:15:29.240285 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Name: None Jul 13 21:15:29.240285 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Identity-Status: Confirmed Jul 13 21:15:29.240285 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Is-Admin-Project: True Jul 13 21:15:29.240285 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Id: default Jul 13 21:15:29.240285 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Name: Default Jul 13 21:15:29.240285 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Id: 0a2703a8b75043e0ab0656482fa9ddeb Jul 13 21:15:29.240285 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Name: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:15:29.240285 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Role: member,reader Jul 13 21:15:29.240285 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Roles: member,reader Jul 13 21:15:29.241933 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a2703a8b75043e0ab0656482fa9ddeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0a2703a8b75043e0ab0656482fa9ddeb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0a2703a8b75043e0ab0656482fa9ddeb", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a2703a8b75043e0ab0656482fa9ddeb"}]}] Jul 13 21:15:29.241933 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:15:29.241933 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Id: 0a2703a8b75043e0ab0656482fa9ddeb Jul 13 21:15:29.241933 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:15:29.241933 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User: tempest-AttachVolumeNegativeTest-334916766-project Jul 13 21:15:29.241933 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Id: default Jul 13 21:15:29.241933 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Name: Default Jul 13 21:15:29.241933 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Id: d9cab6f67cd34c46886d036ba170331e Jul 13 21:15:29.241933 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Name: tempest-AttachVolumeNegativeTest-334916766-project Jul 13 21:15:29.241933 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: method: > Jul 13 21:15:29.241933 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: exception: Instance 22968c28-4691-4e3d-a9e9-dbc923b5fa93 could not be found. Jul 13 21:15:29.241933 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: action_args: {'id': '22968c28-4691-4e3d-a9e9-dbc923b5fa93'} Jul 13 21:15:29.242781 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:15:29.242781 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:29.242781 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:15:29.242781 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:15:29.242781 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:15:29.242781 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:15:29.242781 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:15:29.242781 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:15:29.242781 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:15:29.242781 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:15:29.242781 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22968c28-4691-4e3d-a9e9-dbc923b5fa93 could not be found. Jul 13 21:15:29.242781 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:29.242781 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:29.242781 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:29.242781 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:29.242781 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:29.242781 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:29.242781 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:15:29.242781 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:15:29.242781 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:15:29.244195 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:15:29.244195 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 21:15:29.244195 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 21:15:29.244195 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:15:29.244195 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:15:29.244195 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:15:29.244195 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:15:29.244195 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22968c28-4691-4e3d-a9e9-dbc923b5fa93 could not be found. Jul 13 21:15:29.244195 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:29.244195 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:29.244195 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:29.244195 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:29.244195 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:29.244195 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:29.244195 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:15:29.244195 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:15:29.244195 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22968c28-4691-4e3d-a9e9-dbc923b5fa93 could not be found. Jul 13 21:15:29.244195 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:29.246640 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-24aa8068-4138-4829-8755-42a0a738bc4d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Returning 404 to user: Instance 22968c28-4691-4e3d-a9e9-dbc923b5fa93 could not be found. {{(pid=118445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:15:29.247984 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-24aa8068-4138-4829-8755-42a0a738bc4d tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93" status: 404 len: 111 microversion: 2.1 time: 0.046550 Jul 13 21:15:29.249152 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 572/1123] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:15:29 2022] GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:15:29.258204 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-831f9a6b-c667-4bad-9dc0-38eb55c66a54 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '.version_select at 0x7f96e89a25e0>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:29.292193 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-831f9a6b-c667-4bad-9dc0-38eb55c66a54 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-142931986" status: 202 len: 0 microversion: 2.1 time: 0.038507 Jul 13 21:15:29.293159 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 552/1124] 10.222.0.39 () {58 vars in 1217 bytes} [Wed Jul 13 21:15:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-142931986 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 21:15:31.684032 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-f64552d0-a07c-4221-816d-e1282fa1d923 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:31.686267 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-f64552d0-a07c-4221-816d-e1282fa1d923 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 22968c28-4691-4e3d-a9e9-dbc923b5fa93] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:31.694029 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f64552d0-a07c-4221-816d-e1282fa1d923 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:31.694470 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f64552d0-a07c-4221-816d-e1282fa1d923 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:31.695384 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f64552d0-a07c-4221-816d-e1282fa1d923 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:31.695810 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-f64552d0-a07c-4221-816d-e1282fa1d923 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:31.714212 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.wsgi [None req-f64552d0-a07c-4221-816d-e1282fa1d923 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] HTTP exception thrown: Instance 22968c28-4691-4e3d-a9e9-dbc923b5fa93 could not be found. Jul 13 21:15:31.715983 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-f64552d0-a07c-4221-816d-e1282fa1d923 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Request method failure captured: Jul 13 21:15:31.715983 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: request: DELETE /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93 HTTP/1.1 Jul 13 21:15:31.715983 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept: application/json Jul 13 21:15:31.715983 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept-Encoding: identity Jul 13 21:15:31.715983 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Connection: close Jul 13 21:15:31.715983 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Length: 0 Jul 13 21:15:31.715983 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Type: application/json Jul 13 21:15:31.715983 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Host: 10.222.0.39 Jul 13 21:15:31.715983 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Openstack-System-Scope: None Jul 13 21:15:31.715983 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: User-Agent: python-urllib3/1.26.9 Jul 13 21:15:31.715983 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Auth-Token: gAAAAABizzNqbt1i7chwFPcQAba6b9dk7TD8_G2l_XT7jQopf9IFAZNKmztmBJ4IISK_ds_GpyDLtbYZUS7JtctAPU-Tk1Sa5a4_tbywXB6GjEvdott7LmC4oiwINlLKkOc-EI-NfdeC0sCeq7QrJd1h1pR8691UeSBeFVmfqq10_09s26cRblc Jul 13 21:15:31.715983 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Id: None Jul 13 21:15:31.715983 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Name: None Jul 13 21:15:31.715983 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Identity-Status: Confirmed Jul 13 21:15:31.715983 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Is-Admin-Project: True Jul 13 21:15:31.715983 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Id: default Jul 13 21:15:31.715983 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Name: Default Jul 13 21:15:31.715983 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Id: 0a2703a8b75043e0ab0656482fa9ddeb Jul 13 21:15:31.715983 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Name: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:15:31.715983 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Role: member,reader Jul 13 21:15:31.715983 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Roles: member,reader Jul 13 21:15:31.717632 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a2703a8b75043e0ab0656482fa9ddeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0a2703a8b75043e0ab0656482fa9ddeb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0a2703a8b75043e0ab0656482fa9ddeb", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a2703a8b75043e0ab0656482fa9ddeb"}]}] Jul 13 21:15:31.717632 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:15:31.717632 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Id: 0a2703a8b75043e0ab0656482fa9ddeb Jul 13 21:15:31.717632 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:15:31.717632 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User: tempest-AttachVolumeNegativeTest-334916766-project Jul 13 21:15:31.717632 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Id: default Jul 13 21:15:31.717632 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Name: Default Jul 13 21:15:31.717632 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Id: d9cab6f67cd34c46886d036ba170331e Jul 13 21:15:31.717632 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Name: tempest-AttachVolumeNegativeTest-334916766-project Jul 13 21:15:31.717632 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: method: > Jul 13 21:15:31.717632 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: exception: Instance 22968c28-4691-4e3d-a9e9-dbc923b5fa93 could not be found. Jul 13 21:15:31.717632 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: action_args: {'id': '22968c28-4691-4e3d-a9e9-dbc923b5fa93'} Jul 13 21:15:31.718720 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:15:31.718720 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:31.718720 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:15:31.718720 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:15:31.718720 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:15:31.718720 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:15:31.718720 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:15:31.718720 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:15:31.718720 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:15:31.718720 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:15:31.718720 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22968c28-4691-4e3d-a9e9-dbc923b5fa93 could not be found. Jul 13 21:15:31.718720 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:31.718720 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:31.718720 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:31.718720 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:31.718720 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:31.718720 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:31.718720 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:15:31.718720 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:15:31.718720 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:15:31.720838 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:15:31.720838 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 13 21:15:31.720838 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 13 21:15:31.720838 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 13 21:15:31.720838 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 13 21:15:31.720838 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:15:31.720838 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:15:31.720838 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:15:31.720838 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:15:31.720838 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22968c28-4691-4e3d-a9e9-dbc923b5fa93 could not be found. Jul 13 21:15:31.720838 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:31.720838 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:31.720838 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:31.720838 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:31.720838 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:31.720838 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:31.720838 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:15:31.720838 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:15:31.720838 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22968c28-4691-4e3d-a9e9-dbc923b5fa93 could not be found. Jul 13 21:15:31.720838 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:31.723236 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-f64552d0-a07c-4221-816d-e1282fa1d923 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Returning 404 to user: Instance 22968c28-4691-4e3d-a9e9-dbc923b5fa93 could not be found. {{(pid=118445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:15:31.723236 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-f64552d0-a07c-4221-816d-e1282fa1d923 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "DELETE /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93" status: 404 len: 111 microversion: 2.1 time: 0.040382 Jul 13 21:15:31.723236 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 573/1125] 10.222.0.39 () {58 vars in 1238 bytes} [Wed Jul 13 21:15:31 2022] DELETE /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:15:31.727952 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-e287ffcc-50ec-4c23-a07d-1fa6eb9ac2df tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:31.728594 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-e287ffcc-50ec-4c23-a07d-1fa6eb9ac2df tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 22968c28-4691-4e3d-a9e9-dbc923b5fa93] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:31.736035 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e287ffcc-50ec-4c23-a07d-1fa6eb9ac2df tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:31.736495 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e287ffcc-50ec-4c23-a07d-1fa6eb9ac2df tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:31.737283 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e287ffcc-50ec-4c23-a07d-1fa6eb9ac2df tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:31.737724 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e287ffcc-50ec-4c23-a07d-1fa6eb9ac2df tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:31.770984 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.wsgi [None req-e287ffcc-50ec-4c23-a07d-1fa6eb9ac2df tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] HTTP exception thrown: Instance 22968c28-4691-4e3d-a9e9-dbc923b5fa93 could not be found. Jul 13 21:15:31.773703 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-e287ffcc-50ec-4c23-a07d-1fa6eb9ac2df tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Request method failure captured: Jul 13 21:15:31.773703 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: request: GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93 HTTP/1.1 Jul 13 21:15:31.773703 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept: application/json Jul 13 21:15:31.773703 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept-Encoding: identity Jul 13 21:15:31.773703 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Connection: close Jul 13 21:15:31.773703 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Length: 0 Jul 13 21:15:31.773703 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Type: application/json Jul 13 21:15:31.773703 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Host: 10.222.0.39 Jul 13 21:15:31.773703 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Openstack-System-Scope: None Jul 13 21:15:31.773703 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: User-Agent: python-urllib3/1.26.9 Jul 13 21:15:31.773703 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Auth-Token: gAAAAABizzNqbt1i7chwFPcQAba6b9dk7TD8_G2l_XT7jQopf9IFAZNKmztmBJ4IISK_ds_GpyDLtbYZUS7JtctAPU-Tk1Sa5a4_tbywXB6GjEvdott7LmC4oiwINlLKkOc-EI-NfdeC0sCeq7QrJd1h1pR8691UeSBeFVmfqq10_09s26cRblc Jul 13 21:15:31.773703 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Id: None Jul 13 21:15:31.773703 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Name: None Jul 13 21:15:31.773703 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Identity-Status: Confirmed Jul 13 21:15:31.773703 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Is-Admin-Project: True Jul 13 21:15:31.773703 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Id: default Jul 13 21:15:31.773703 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Name: Default Jul 13 21:15:31.773703 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Id: 0a2703a8b75043e0ab0656482fa9ddeb Jul 13 21:15:31.773703 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Name: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:15:31.773703 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Role: member,reader Jul 13 21:15:31.773703 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Roles: member,reader Jul 13 21:15:31.775679 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a2703a8b75043e0ab0656482fa9ddeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0a2703a8b75043e0ab0656482fa9ddeb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0a2703a8b75043e0ab0656482fa9ddeb", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a2703a8b75043e0ab0656482fa9ddeb"}]}] Jul 13 21:15:31.775679 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:15:31.775679 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Id: 0a2703a8b75043e0ab0656482fa9ddeb Jul 13 21:15:31.775679 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:15:31.775679 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User: tempest-AttachVolumeNegativeTest-334916766-project Jul 13 21:15:31.775679 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Id: default Jul 13 21:15:31.775679 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Name: Default Jul 13 21:15:31.775679 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Id: d9cab6f67cd34c46886d036ba170331e Jul 13 21:15:31.775679 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Name: tempest-AttachVolumeNegativeTest-334916766-project Jul 13 21:15:31.775679 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: method: > Jul 13 21:15:31.775679 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: exception: Instance 22968c28-4691-4e3d-a9e9-dbc923b5fa93 could not be found. Jul 13 21:15:31.775679 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: action_args: {'id': '22968c28-4691-4e3d-a9e9-dbc923b5fa93'} Jul 13 21:15:31.776737 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:15:31.776737 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:31.776737 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:15:31.776737 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:15:31.776737 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:15:31.776737 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:15:31.776737 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:15:31.776737 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:15:31.776737 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:15:31.776737 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:15:31.776737 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22968c28-4691-4e3d-a9e9-dbc923b5fa93 could not be found. Jul 13 21:15:31.776737 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:31.776737 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:31.776737 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:31.776737 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:31.776737 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:31.776737 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:31.776737 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:15:31.776737 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:15:31.776737 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:15:31.778203 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:15:31.778203 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 21:15:31.778203 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 21:15:31.778203 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:15:31.778203 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:15:31.778203 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:15:31.778203 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:15:31.778203 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22968c28-4691-4e3d-a9e9-dbc923b5fa93 could not be found. Jul 13 21:15:31.778203 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:31.778203 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:31.778203 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:31.778203 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:31.778203 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:31.778203 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:31.778203 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:15:31.778203 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:15:31.778203 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22968c28-4691-4e3d-a9e9-dbc923b5fa93 could not be found. Jul 13 21:15:31.778203 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:31.780562 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-e287ffcc-50ec-4c23-a07d-1fa6eb9ac2df tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Returning 404 to user: Instance 22968c28-4691-4e3d-a9e9-dbc923b5fa93 could not be found. {{(pid=118444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:15:31.782744 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-e287ffcc-50ec-4c23-a07d-1fa6eb9ac2df tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93" status: 404 len: 111 microversion: 2.1 time: 0.059009 Jul 13 21:15:31.786507 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 553/1126] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:15:31 2022] GET /compute/v2.1/servers/22968c28-4691-4e3d-a9e9-dbc923b5fa93 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:15:32.966558 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-be63296f-92a7-4f96-a5fb-fc05654bb8f1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:32.967176 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-be63296f-92a7-4f96-a5fb-fc05654bb8f1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:32.973745 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-be63296f-92a7-4f96-a5fb-fc05654bb8f1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:32.974188 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-be63296f-92a7-4f96-a5fb-fc05654bb8f1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:32.974972 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-be63296f-92a7-4f96-a5fb-fc05654bb8f1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:32.975400 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-be63296f-92a7-4f96-a5fb-fc05654bb8f1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:32.989891 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.wsgi [None req-be63296f-92a7-4f96-a5fb-fc05654bb8f1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] HTTP exception thrown: Instance 823dc842-377a-4438-a1c5-73b5cce4cda2 could not be found. Jul 13 21:15:32.991448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-be63296f-92a7-4f96-a5fb-fc05654bb8f1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Request method failure captured: Jul 13 21:15:32.991448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: request: DELETE /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2 HTTP/1.1 Jul 13 21:15:32.991448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept: application/json Jul 13 21:15:32.991448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept-Encoding: identity Jul 13 21:15:32.991448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Connection: close Jul 13 21:15:32.991448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Length: 0 Jul 13 21:15:32.991448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Type: application/json Jul 13 21:15:32.991448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Host: 10.222.0.39 Jul 13 21:15:32.991448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Openstack-System-Scope: None Jul 13 21:15:32.991448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: User-Agent: python-urllib3/1.26.9 Jul 13 21:15:32.991448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Auth-Token: gAAAAABizzNqbt1i7chwFPcQAba6b9dk7TD8_G2l_XT7jQopf9IFAZNKmztmBJ4IISK_ds_GpyDLtbYZUS7JtctAPU-Tk1Sa5a4_tbywXB6GjEvdott7LmC4oiwINlLKkOc-EI-NfdeC0sCeq7QrJd1h1pR8691UeSBeFVmfqq10_09s26cRblc Jul 13 21:15:32.991448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Id: None Jul 13 21:15:32.991448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Name: None Jul 13 21:15:32.991448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Identity-Status: Confirmed Jul 13 21:15:32.991448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Is-Admin-Project: True Jul 13 21:15:32.991448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Id: default Jul 13 21:15:32.991448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Name: Default Jul 13 21:15:32.991448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Id: 0a2703a8b75043e0ab0656482fa9ddeb Jul 13 21:15:32.991448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Name: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:15:32.991448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Role: member,reader Jul 13 21:15:32.991448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Roles: member,reader Jul 13 21:15:32.992849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a2703a8b75043e0ab0656482fa9ddeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0a2703a8b75043e0ab0656482fa9ddeb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0a2703a8b75043e0ab0656482fa9ddeb", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a2703a8b75043e0ab0656482fa9ddeb"}]}] Jul 13 21:15:32.992849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:15:32.992849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Id: 0a2703a8b75043e0ab0656482fa9ddeb Jul 13 21:15:32.992849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:15:32.992849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User: tempest-AttachVolumeNegativeTest-334916766-project Jul 13 21:15:32.992849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Id: default Jul 13 21:15:32.992849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Name: Default Jul 13 21:15:32.992849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Id: d9cab6f67cd34c46886d036ba170331e Jul 13 21:15:32.992849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Name: tempest-AttachVolumeNegativeTest-334916766-project Jul 13 21:15:32.992849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: method: > Jul 13 21:15:32.992849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: exception: Instance 823dc842-377a-4438-a1c5-73b5cce4cda2 could not be found. Jul 13 21:15:32.992849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: action_args: {'id': '823dc842-377a-4438-a1c5-73b5cce4cda2'} Jul 13 21:15:32.994651 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:15:32.994651 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:32.994651 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:15:32.994651 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:15:32.994651 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:15:32.994651 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:15:32.994651 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:15:32.994651 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:15:32.994651 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:15:32.994651 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:15:32.994651 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 823dc842-377a-4438-a1c5-73b5cce4cda2 could not be found. Jul 13 21:15:32.994651 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:32.994651 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:32.994651 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:32.994651 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:32.994651 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:32.994651 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:32.994651 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:15:32.994651 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:15:32.994651 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:15:32.995910 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:15:32.995910 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 13 21:15:32.995910 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 13 21:15:32.995910 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 13 21:15:32.995910 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 13 21:15:32.995910 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:15:32.995910 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:15:32.995910 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:15:32.995910 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:15:32.995910 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 823dc842-377a-4438-a1c5-73b5cce4cda2 could not be found. Jul 13 21:15:32.995910 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:32.995910 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:32.995910 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:32.995910 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:32.995910 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:32.995910 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:32.995910 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:15:32.995910 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:15:32.995910 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 823dc842-377a-4438-a1c5-73b5cce4cda2 could not be found. Jul 13 21:15:32.995910 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:32.998138 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-be63296f-92a7-4f96-a5fb-fc05654bb8f1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Returning 404 to user: Instance 823dc842-377a-4438-a1c5-73b5cce4cda2 could not be found. {{(pid=118445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:15:32.998138 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-be63296f-92a7-4f96-a5fb-fc05654bb8f1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "DELETE /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2" status: 404 len: 111 microversion: 2.1 time: 0.031698 Jul 13 21:15:32.998138 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 574/1127] 10.222.0.39 () {58 vars in 1238 bytes} [Wed Jul 13 21:15:32 2022] DELETE /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:15:33.003205 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-19c239e4-4919-454e-8fd2-01a675dda28f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:33.004003 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-19c239e4-4919-454e-8fd2-01a675dda28f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 823dc842-377a-4438-a1c5-73b5cce4cda2] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:33.011030 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-19c239e4-4919-454e-8fd2-01a675dda28f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:33.011492 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-19c239e4-4919-454e-8fd2-01a675dda28f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:33.012273 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-19c239e4-4919-454e-8fd2-01a675dda28f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:33.012881 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-19c239e4-4919-454e-8fd2-01a675dda28f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:33.026705 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.wsgi [None req-19c239e4-4919-454e-8fd2-01a675dda28f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] HTTP exception thrown: Instance 823dc842-377a-4438-a1c5-73b5cce4cda2 could not be found. Jul 13 21:15:33.029119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-19c239e4-4919-454e-8fd2-01a675dda28f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Request method failure captured: Jul 13 21:15:33.029119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: request: GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2 HTTP/1.1 Jul 13 21:15:33.029119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept: application/json Jul 13 21:15:33.029119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept-Encoding: identity Jul 13 21:15:33.029119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Connection: close Jul 13 21:15:33.029119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Length: 0 Jul 13 21:15:33.029119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Type: application/json Jul 13 21:15:33.029119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Host: 10.222.0.39 Jul 13 21:15:33.029119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Openstack-System-Scope: None Jul 13 21:15:33.029119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: User-Agent: python-urllib3/1.26.9 Jul 13 21:15:33.029119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Auth-Token: gAAAAABizzNqbt1i7chwFPcQAba6b9dk7TD8_G2l_XT7jQopf9IFAZNKmztmBJ4IISK_ds_GpyDLtbYZUS7JtctAPU-Tk1Sa5a4_tbywXB6GjEvdott7LmC4oiwINlLKkOc-EI-NfdeC0sCeq7QrJd1h1pR8691UeSBeFVmfqq10_09s26cRblc Jul 13 21:15:33.029119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Id: None Jul 13 21:15:33.029119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Name: None Jul 13 21:15:33.029119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Identity-Status: Confirmed Jul 13 21:15:33.029119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Is-Admin-Project: True Jul 13 21:15:33.029119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Id: default Jul 13 21:15:33.029119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Name: Default Jul 13 21:15:33.029119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Id: 0a2703a8b75043e0ab0656482fa9ddeb Jul 13 21:15:33.029119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Name: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:15:33.029119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Role: member,reader Jul 13 21:15:33.029119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Roles: member,reader Jul 13 21:15:33.030488 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a2703a8b75043e0ab0656482fa9ddeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0a2703a8b75043e0ab0656482fa9ddeb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0a2703a8b75043e0ab0656482fa9ddeb", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a2703a8b75043e0ab0656482fa9ddeb"}]}] Jul 13 21:15:33.030488 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:15:33.030488 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Id: 0a2703a8b75043e0ab0656482fa9ddeb Jul 13 21:15:33.030488 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:15:33.030488 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User: tempest-AttachVolumeNegativeTest-334916766-project Jul 13 21:15:33.030488 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Id: default Jul 13 21:15:33.030488 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Name: Default Jul 13 21:15:33.030488 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Id: d9cab6f67cd34c46886d036ba170331e Jul 13 21:15:33.030488 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Name: tempest-AttachVolumeNegativeTest-334916766-project Jul 13 21:15:33.030488 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: method: > Jul 13 21:15:33.030488 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: exception: Instance 823dc842-377a-4438-a1c5-73b5cce4cda2 could not be found. Jul 13 21:15:33.030488 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: action_args: {'id': '823dc842-377a-4438-a1c5-73b5cce4cda2'} Jul 13 21:15:33.031266 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:15:33.031266 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:33.031266 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:15:33.031266 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:15:33.031266 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:15:33.031266 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:15:33.031266 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:15:33.031266 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:15:33.031266 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:15:33.031266 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:15:33.031266 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 823dc842-377a-4438-a1c5-73b5cce4cda2 could not be found. Jul 13 21:15:33.031266 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:33.031266 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:33.031266 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:33.031266 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:33.031266 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:33.031266 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:33.031266 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:15:33.031266 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:15:33.031266 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:15:33.032463 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:15:33.032463 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 21:15:33.032463 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 21:15:33.032463 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:15:33.032463 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:15:33.032463 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:15:33.032463 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:15:33.032463 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 823dc842-377a-4438-a1c5-73b5cce4cda2 could not be found. Jul 13 21:15:33.032463 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:33.032463 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:33.032463 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:33.032463 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:33.032463 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:33.032463 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:33.032463 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:15:33.032463 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:15:33.032463 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 823dc842-377a-4438-a1c5-73b5cce4cda2 could not be found. Jul 13 21:15:33.032463 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:33.033629 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-19c239e4-4919-454e-8fd2-01a675dda28f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Returning 404 to user: Instance 823dc842-377a-4438-a1c5-73b5cce4cda2 could not be found. {{(pid=118444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:15:33.033629 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-19c239e4-4919-454e-8fd2-01a675dda28f tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2" status: 404 len: 111 microversion: 2.1 time: 0.032754 Jul 13 21:15:33.033629 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 554/1128] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:15:32 2022] GET /compute/v2.1/servers/823dc842-377a-4438-a1c5-73b5cce4cda2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:15:33.039292 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-03cd8d97-8dd4-4951-ab9c-dd8976a9b7e0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:33.039792 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-03cd8d97-8dd4-4951-ab9c-dd8976a9b7e0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:33.046134 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-03cd8d97-8dd4-4951-ab9c-dd8976a9b7e0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:33.046584 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-03cd8d97-8dd4-4951-ab9c-dd8976a9b7e0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:33.047418 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-03cd8d97-8dd4-4951-ab9c-dd8976a9b7e0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:33.047914 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-03cd8d97-8dd4-4951-ab9c-dd8976a9b7e0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:33.064050 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.wsgi [None req-03cd8d97-8dd4-4951-ab9c-dd8976a9b7e0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] HTTP exception thrown: Instance 8a127418-a227-4cf6-a36c-822265e0b11f could not be found. Jul 13 21:15:33.066104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-03cd8d97-8dd4-4951-ab9c-dd8976a9b7e0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Request method failure captured: Jul 13 21:15:33.066104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: request: DELETE /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f HTTP/1.1 Jul 13 21:15:33.066104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept: application/json Jul 13 21:15:33.066104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept-Encoding: identity Jul 13 21:15:33.066104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Connection: close Jul 13 21:15:33.066104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Length: 0 Jul 13 21:15:33.066104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Type: application/json Jul 13 21:15:33.066104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Host: 10.222.0.39 Jul 13 21:15:33.066104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Openstack-System-Scope: None Jul 13 21:15:33.066104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: User-Agent: python-urllib3/1.26.9 Jul 13 21:15:33.066104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Auth-Token: gAAAAABizzNqbt1i7chwFPcQAba6b9dk7TD8_G2l_XT7jQopf9IFAZNKmztmBJ4IISK_ds_GpyDLtbYZUS7JtctAPU-Tk1Sa5a4_tbywXB6GjEvdott7LmC4oiwINlLKkOc-EI-NfdeC0sCeq7QrJd1h1pR8691UeSBeFVmfqq10_09s26cRblc Jul 13 21:15:33.066104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Id: None Jul 13 21:15:33.066104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Name: None Jul 13 21:15:33.066104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Identity-Status: Confirmed Jul 13 21:15:33.066104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Is-Admin-Project: True Jul 13 21:15:33.066104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Id: default Jul 13 21:15:33.066104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Name: Default Jul 13 21:15:33.066104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Id: 0a2703a8b75043e0ab0656482fa9ddeb Jul 13 21:15:33.066104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Name: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:15:33.066104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Role: member,reader Jul 13 21:15:33.066104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Roles: member,reader Jul 13 21:15:33.067512 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a2703a8b75043e0ab0656482fa9ddeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0a2703a8b75043e0ab0656482fa9ddeb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0a2703a8b75043e0ab0656482fa9ddeb", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a2703a8b75043e0ab0656482fa9ddeb"}]}] Jul 13 21:15:33.067512 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:15:33.067512 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Id: 0a2703a8b75043e0ab0656482fa9ddeb Jul 13 21:15:33.067512 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:15:33.067512 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User: tempest-AttachVolumeNegativeTest-334916766-project Jul 13 21:15:33.067512 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Id: default Jul 13 21:15:33.067512 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Name: Default Jul 13 21:15:33.067512 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Id: d9cab6f67cd34c46886d036ba170331e Jul 13 21:15:33.067512 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Name: tempest-AttachVolumeNegativeTest-334916766-project Jul 13 21:15:33.067512 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: method: > Jul 13 21:15:33.067512 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: exception: Instance 8a127418-a227-4cf6-a36c-822265e0b11f could not be found. Jul 13 21:15:33.067512 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: action_args: {'id': '8a127418-a227-4cf6-a36c-822265e0b11f'} Jul 13 21:15:33.068314 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:15:33.068314 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:33.068314 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:15:33.068314 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:15:33.068314 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:15:33.068314 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:15:33.068314 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:15:33.068314 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:15:33.068314 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:15:33.068314 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:15:33.068314 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a127418-a227-4cf6-a36c-822265e0b11f could not be found. Jul 13 21:15:33.068314 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:33.068314 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:33.068314 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:33.068314 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:33.068314 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:33.068314 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:33.068314 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:15:33.068314 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:15:33.068314 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:15:33.070465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:15:33.070465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 13 21:15:33.070465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 13 21:15:33.070465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 13 21:15:33.070465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 13 21:15:33.070465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:15:33.070465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:15:33.070465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:15:33.070465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:15:33.070465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a127418-a227-4cf6-a36c-822265e0b11f could not be found. Jul 13 21:15:33.070465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:33.070465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:33.070465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:33.070465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:33.070465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:33.070465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:33.070465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:15:33.070465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:15:33.070465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a127418-a227-4cf6-a36c-822265e0b11f could not be found. Jul 13 21:15:33.070465 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:33.072108 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-03cd8d97-8dd4-4951-ab9c-dd8976a9b7e0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Returning 404 to user: Instance 8a127418-a227-4cf6-a36c-822265e0b11f could not be found. {{(pid=118445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:15:33.072108 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-03cd8d97-8dd4-4951-ab9c-dd8976a9b7e0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 404 len: 111 microversion: 2.1 time: 0.032090 Jul 13 21:15:33.072108 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 575/1129] 10.222.0.39 () {58 vars in 1238 bytes} [Wed Jul 13 21:15:33 2022] DELETE /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:15:33.078226 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-01af9355-9f91-442a-8ae4-f5e1bbf167ab tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:33.078883 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-01af9355-9f91-442a-8ae4-f5e1bbf167ab tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 8a127418-a227-4cf6-a36c-822265e0b11f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:33.085033 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-01af9355-9f91-442a-8ae4-f5e1bbf167ab tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:33.085513 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-01af9355-9f91-442a-8ae4-f5e1bbf167ab tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:33.086282 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-01af9355-9f91-442a-8ae4-f5e1bbf167ab tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:33.086758 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-01af9355-9f91-442a-8ae4-f5e1bbf167ab tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:33.102662 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.wsgi [None req-01af9355-9f91-442a-8ae4-f5e1bbf167ab tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] HTTP exception thrown: Instance 8a127418-a227-4cf6-a36c-822265e0b11f could not be found. Jul 13 21:15:33.104191 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-01af9355-9f91-442a-8ae4-f5e1bbf167ab tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Request method failure captured: Jul 13 21:15:33.104191 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: request: GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f HTTP/1.1 Jul 13 21:15:33.104191 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept: application/json Jul 13 21:15:33.104191 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept-Encoding: identity Jul 13 21:15:33.104191 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Connection: close Jul 13 21:15:33.104191 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Length: 0 Jul 13 21:15:33.104191 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Type: application/json Jul 13 21:15:33.104191 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Host: 10.222.0.39 Jul 13 21:15:33.104191 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Openstack-System-Scope: None Jul 13 21:15:33.104191 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: User-Agent: python-urllib3/1.26.9 Jul 13 21:15:33.104191 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Auth-Token: gAAAAABizzNqbt1i7chwFPcQAba6b9dk7TD8_G2l_XT7jQopf9IFAZNKmztmBJ4IISK_ds_GpyDLtbYZUS7JtctAPU-Tk1Sa5a4_tbywXB6GjEvdott7LmC4oiwINlLKkOc-EI-NfdeC0sCeq7QrJd1h1pR8691UeSBeFVmfqq10_09s26cRblc Jul 13 21:15:33.104191 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Id: None Jul 13 21:15:33.104191 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Name: None Jul 13 21:15:33.104191 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Identity-Status: Confirmed Jul 13 21:15:33.104191 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Is-Admin-Project: True Jul 13 21:15:33.104191 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Id: default Jul 13 21:15:33.104191 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Name: Default Jul 13 21:15:33.104191 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Id: 0a2703a8b75043e0ab0656482fa9ddeb Jul 13 21:15:33.104191 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Name: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:15:33.104191 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Role: member,reader Jul 13 21:15:33.104191 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Roles: member,reader Jul 13 21:15:33.105619 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a2703a8b75043e0ab0656482fa9ddeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0a2703a8b75043e0ab0656482fa9ddeb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0a2703a8b75043e0ab0656482fa9ddeb", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a2703a8b75043e0ab0656482fa9ddeb"}]}] Jul 13 21:15:33.105619 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:15:33.105619 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Id: 0a2703a8b75043e0ab0656482fa9ddeb Jul 13 21:15:33.105619 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:15:33.105619 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User: tempest-AttachVolumeNegativeTest-334916766-project Jul 13 21:15:33.105619 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Id: default Jul 13 21:15:33.105619 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Name: Default Jul 13 21:15:33.105619 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Id: d9cab6f67cd34c46886d036ba170331e Jul 13 21:15:33.105619 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Name: tempest-AttachVolumeNegativeTest-334916766-project Jul 13 21:15:33.105619 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: method: > Jul 13 21:15:33.105619 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: exception: Instance 8a127418-a227-4cf6-a36c-822265e0b11f could not be found. Jul 13 21:15:33.105619 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: action_args: {'id': '8a127418-a227-4cf6-a36c-822265e0b11f'} Jul 13 21:15:33.106361 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:15:33.106361 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:33.106361 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:15:33.106361 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:15:33.106361 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:15:33.106361 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:15:33.106361 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:15:33.106361 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:15:33.106361 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:15:33.106361 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:15:33.106361 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a127418-a227-4cf6-a36c-822265e0b11f could not be found. Jul 13 21:15:33.106361 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:33.106361 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:33.106361 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:33.106361 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:33.106361 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:33.106361 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:33.106361 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:15:33.106361 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:15:33.106361 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:15:33.108288 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:15:33.108288 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 21:15:33.108288 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 21:15:33.108288 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:15:33.108288 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:15:33.108288 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:15:33.108288 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:15:33.108288 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a127418-a227-4cf6-a36c-822265e0b11f could not be found. Jul 13 21:15:33.108288 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:33.108288 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:33.108288 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:33.108288 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:33.108288 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:33.108288 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:33.108288 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:15:33.108288 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:15:33.108288 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a127418-a227-4cf6-a36c-822265e0b11f could not be found. Jul 13 21:15:33.108288 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:33.110034 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-01af9355-9f91-442a-8ae4-f5e1bbf167ab tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Returning 404 to user: Instance 8a127418-a227-4cf6-a36c-822265e0b11f could not be found. {{(pid=118444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:15:33.110034 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-01af9355-9f91-442a-8ae4-f5e1bbf167ab tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f" status: 404 len: 111 microversion: 2.1 time: 0.031584 Jul 13 21:15:33.110034 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 555/1130] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:15:33 2022] GET /compute/v2.1/servers/8a127418-a227-4cf6-a36c-822265e0b11f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:15:34.259349 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-56f9b0bb-e3fc-493b-aa59-a914fafdb7c0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:34.259854 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-56f9b0bb-e3fc-493b-aa59-a914fafdb7c0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:34.276389 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-56f9b0bb-e3fc-493b-aa59-a914fafdb7c0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:34.276827 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-56f9b0bb-e3fc-493b-aa59-a914fafdb7c0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:34.277585 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-56f9b0bb-e3fc-493b-aa59-a914fafdb7c0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:34.278016 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-56f9b0bb-e3fc-493b-aa59-a914fafdb7c0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:34.291881 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.wsgi [None req-56f9b0bb-e3fc-493b-aa59-a914fafdb7c0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] HTTP exception thrown: Instance 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f could not be found. Jul 13 21:15:34.293703 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-56f9b0bb-e3fc-493b-aa59-a914fafdb7c0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Request method failure captured: Jul 13 21:15:34.293703 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: request: DELETE /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f HTTP/1.1 Jul 13 21:15:34.293703 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept: application/json Jul 13 21:15:34.293703 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept-Encoding: identity Jul 13 21:15:34.293703 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Connection: close Jul 13 21:15:34.293703 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Length: 0 Jul 13 21:15:34.293703 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Type: application/json Jul 13 21:15:34.293703 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Host: 10.222.0.39 Jul 13 21:15:34.293703 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Openstack-System-Scope: None Jul 13 21:15:34.293703 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: User-Agent: python-urllib3/1.26.9 Jul 13 21:15:34.293703 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Auth-Token: gAAAAABizzNqbt1i7chwFPcQAba6b9dk7TD8_G2l_XT7jQopf9IFAZNKmztmBJ4IISK_ds_GpyDLtbYZUS7JtctAPU-Tk1Sa5a4_tbywXB6GjEvdott7LmC4oiwINlLKkOc-EI-NfdeC0sCeq7QrJd1h1pR8691UeSBeFVmfqq10_09s26cRblc Jul 13 21:15:34.293703 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Id: None Jul 13 21:15:34.293703 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Name: None Jul 13 21:15:34.293703 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Identity-Status: Confirmed Jul 13 21:15:34.293703 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Is-Admin-Project: True Jul 13 21:15:34.293703 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Id: default Jul 13 21:15:34.293703 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Name: Default Jul 13 21:15:34.293703 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Id: 0a2703a8b75043e0ab0656482fa9ddeb Jul 13 21:15:34.293703 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Name: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:15:34.293703 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Role: member,reader Jul 13 21:15:34.293703 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Roles: member,reader Jul 13 21:15:34.295695 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a2703a8b75043e0ab0656482fa9ddeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0a2703a8b75043e0ab0656482fa9ddeb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0a2703a8b75043e0ab0656482fa9ddeb", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a2703a8b75043e0ab0656482fa9ddeb"}]}] Jul 13 21:15:34.295695 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:15:34.295695 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Id: 0a2703a8b75043e0ab0656482fa9ddeb Jul 13 21:15:34.295695 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:15:34.295695 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User: tempest-AttachVolumeNegativeTest-334916766-project Jul 13 21:15:34.295695 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Id: default Jul 13 21:15:34.295695 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Name: Default Jul 13 21:15:34.295695 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Id: d9cab6f67cd34c46886d036ba170331e Jul 13 21:15:34.295695 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Name: tempest-AttachVolumeNegativeTest-334916766-project Jul 13 21:15:34.295695 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: method: > Jul 13 21:15:34.295695 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: exception: Instance 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f could not be found. Jul 13 21:15:34.295695 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: action_args: {'id': '52701d54-bab0-4fd7-b5c1-1b0e433d4c9f'} Jul 13 21:15:34.296701 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:15:34.296701 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:34.296701 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:15:34.296701 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:15:34.296701 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:15:34.296701 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:15:34.296701 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:15:34.296701 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:15:34.296701 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:15:34.296701 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:15:34.296701 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f could not be found. Jul 13 21:15:34.296701 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:34.296701 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:34.296701 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:34.296701 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:34.296701 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:34.296701 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:34.296701 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:15:34.296701 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:15:34.296701 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:15:34.298190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:15:34.298190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 13 21:15:34.298190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 13 21:15:34.298190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 13 21:15:34.298190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 13 21:15:34.298190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:15:34.298190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:15:34.298190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:15:34.298190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:15:34.298190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f could not be found. Jul 13 21:15:34.298190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:34.298190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:34.298190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:34.298190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:34.298190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:34.298190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:34.298190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:15:34.298190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:15:34.298190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f could not be found. Jul 13 21:15:34.298190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:15:34.301783 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-56f9b0bb-e3fc-493b-aa59-a914fafdb7c0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Returning 404 to user: Instance 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f could not be found. {{(pid=118445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:15:34.301783 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-56f9b0bb-e3fc-493b-aa59-a914fafdb7c0 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "DELETE /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 404 len: 111 microversion: 2.1 time: 0.039954 Jul 13 21:15:34.301783 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 576/1131] 10.222.0.39 () {58 vars in 1238 bytes} [Wed Jul 13 21:15:34 2022] DELETE /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:15:34.307043 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0ae8d44c-1de8-4334-95ed-780a380401e1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:15:34.307670 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-0ae8d44c-1de8-4334-95ed-780a380401e1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] [instance: 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:15:34.313782 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0ae8d44c-1de8-4334-95ed-780a380401e1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:34.314946 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0ae8d44c-1de8-4334-95ed-780a380401e1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:34.315572 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0ae8d44c-1de8-4334-95ed-780a380401e1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:15:34.316214 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0ae8d44c-1de8-4334-95ed-780a380401e1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:15:34.330304 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.wsgi [None req-0ae8d44c-1de8-4334-95ed-780a380401e1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] HTTP exception thrown: Instance 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f could not be found. Jul 13 21:15:34.331863 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0ae8d44c-1de8-4334-95ed-780a380401e1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Request method failure captured: Jul 13 21:15:34.331863 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: request: GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f HTTP/1.1 Jul 13 21:15:34.331863 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept: application/json Jul 13 21:15:34.331863 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept-Encoding: identity Jul 13 21:15:34.331863 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Connection: close Jul 13 21:15:34.331863 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Length: 0 Jul 13 21:15:34.331863 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Type: application/json Jul 13 21:15:34.331863 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Host: 10.222.0.39 Jul 13 21:15:34.331863 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Openstack-System-Scope: None Jul 13 21:15:34.331863 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: User-Agent: python-urllib3/1.26.9 Jul 13 21:15:34.331863 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Auth-Token: gAAAAABizzNqbt1i7chwFPcQAba6b9dk7TD8_G2l_XT7jQopf9IFAZNKmztmBJ4IISK_ds_GpyDLtbYZUS7JtctAPU-Tk1Sa5a4_tbywXB6GjEvdott7LmC4oiwINlLKkOc-EI-NfdeC0sCeq7QrJd1h1pR8691UeSBeFVmfqq10_09s26cRblc Jul 13 21:15:34.331863 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Id: None Jul 13 21:15:34.331863 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Name: None Jul 13 21:15:34.331863 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Identity-Status: Confirmed Jul 13 21:15:34.331863 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Is-Admin-Project: True Jul 13 21:15:34.331863 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Id: default Jul 13 21:15:34.331863 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Name: Default Jul 13 21:15:34.331863 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Id: 0a2703a8b75043e0ab0656482fa9ddeb Jul 13 21:15:34.331863 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Name: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:15:34.331863 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Role: member,reader Jul 13 21:15:34.331863 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Roles: member,reader Jul 13 21:15:34.333530 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a2703a8b75043e0ab0656482fa9ddeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0a2703a8b75043e0ab0656482fa9ddeb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0a2703a8b75043e0ab0656482fa9ddeb", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a2703a8b75043e0ab0656482fa9ddeb"}]}] Jul 13 21:15:34.333530 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:15:34.333530 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Id: 0a2703a8b75043e0ab0656482fa9ddeb Jul 13 21:15:34.333530 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-334916766 Jul 13 21:15:34.333530 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User: tempest-AttachVolumeNegativeTest-334916766-project Jul 13 21:15:34.333530 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Id: default Jul 13 21:15:34.333530 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Name: Default Jul 13 21:15:34.333530 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Id: d9cab6f67cd34c46886d036ba170331e Jul 13 21:15:34.333530 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Name: tempest-AttachVolumeNegativeTest-334916766-project Jul 13 21:15:34.333530 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: method: > Jul 13 21:15:34.333530 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: exception: Instance 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f could not be found. Jul 13 21:15:34.333530 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: action_args: {'id': '52701d54-bab0-4fd7-b5c1-1b0e433d4c9f'} Jul 13 21:15:34.334417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:15:34.334417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:34.334417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:15:34.334417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:15:34.334417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:15:34.334417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:15:34.334417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:15:34.334417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:15:34.334417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:15:34.334417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:15:34.334417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f could not be found. Jul 13 21:15:34.334417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:34.334417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:34.334417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:34.334417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:34.334417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:34.334417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:34.334417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:15:34.334417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:15:34.334417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:15:34.336232 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:15:34.336232 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 21:15:34.336232 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 21:15:34.336232 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:15:34.336232 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:15:34.336232 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:15:34.336232 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:15:34.336232 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f could not be found. Jul 13 21:15:34.336232 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:34.336232 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:15:34.336232 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:34.336232 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:15:34.336232 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:15:34.336232 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:15:34.336232 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:15:34.336232 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:15:34.336232 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f could not be found. Jul 13 21:15:34.336232 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:15:34.338319 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0ae8d44c-1de8-4334-95ed-780a380401e1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] Returning 404 to user: Instance 52701d54-bab0-4fd7-b5c1-1b0e433d4c9f could not be found. {{(pid=118444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:15:34.338319 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-0ae8d44c-1de8-4334-95ed-780a380401e1 tempest-AttachVolumeNegativeTest-334916766 tempest-AttachVolumeNegativeTest-334916766-project] 10.222.0.39 "GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f" status: 404 len: 111 microversion: 2.1 time: 0.030035 Jul 13 21:15:34.338319 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 556/1132] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:15:34 2022] GET /compute/v2.1/servers/52701d54-bab0-4fd7-b5c1-1b0e433d4c9f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:16:16.577980 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-2d62be1e-1422-4c10-8cd1-29c0f3ced4ef tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-190961325", "imageRef": "5a995c88-d784-4a51-a6b9-25aa9dfe607c", "flavorRef": "452"}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:16:16.583883 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_api:SELECT=31 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:16:16.584569 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=63 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:16:16.631497 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.network.neutron [None req-2d62be1e-1422-4c10-8cd1-29c0f3ced4ef tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] validate_networks() for None {{(pid=118445) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 21:16:17.208352 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-2d62be1e-1422-4c10-8cd1-29c0f3ced4ef tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Flavor limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 21:16:17.209158 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-2d62be1e-1422-4c10-8cd1-29c0f3ced4ef tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Image limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 21:16:17.209824 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-2d62be1e-1422-4c10-8cd1-29c0f3ced4ef tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Flavor pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 21:16:17.211032 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-2d62be1e-1422-4c10-8cd1-29c0f3ced4ef tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Image pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 21:16:17.211457 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-2d62be1e-1422-4c10-8cd1-29c0f3ced4ef tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 21:16:17.221882 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2d62be1e-1422-4c10-8cd1-29c0f3ced4ef tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:17.222344 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2d62be1e-1422-4c10-8cd1-29c0f3ced4ef tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:17.223287 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2d62be1e-1422-4c10-8cd1-29c0f3ced4ef tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:17.223616 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2d62be1e-1422-4c10-8cd1-29c0f3ced4ef tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:17.245660 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-2d62be1e-1422-4c10-8cd1-29c0f3ced4ef tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Getting quotas for project 908836d993404006970ed39a9613b600. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:16:17.249766 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-2d62be1e-1422-4c10-8cd1-29c0f3ced4ef tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Getting quotas for user 96d247f90aa5449dbd54a4ea86458f17 and project 908836d993404006970ed39a9613b600. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:16:17.261507 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-2d62be1e-1422-4c10-8cd1-29c0f3ced4ef tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Going to run 1 instances... {{(pid=118445) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 21:16:17.263815 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-2d62be1e-1422-4c10-8cd1-29c0f3ced4ef tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] [instance: 85532e75-4b13-481c-af2c-f75465a122cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995c88-d784-4a51-a6b9-25aa9dfe607c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118445) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 21:16:17.308460 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2d62be1e-1422-4c10-8cd1-29c0f3ced4ef tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] [88571754-d3ea-4982-a252-0f484e8cc9c5] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 13 21:16:18.318246 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO oslo.messaging._drivers.impl_rabbit [None req-2d62be1e-1422-4c10-8cd1-29c0f3ced4ef tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] [88571754-d3ea-4982-a252-0f484e8cc9c5] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 53778. Jul 13 21:16:18.323637 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-2d62be1e-1422-4c10-8cd1-29c0f3ced4ef tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.749828 Jul 13 21:16:18.324374 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 577/1133] 10.222.0.39 () {60 vars in 1146 bytes} [Wed Jul 13 21:16:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 21:16:18.334227 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-148846c4-3716-4555-ae17-781836c47144 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:18.335087 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-148846c4-3716-4555-ae17-781836c47144 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] [instance: 85532e75-4b13-481c-af2c-f75465a122cb] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:18.338091 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:16:18.338933 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:16:18.396390 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-148846c4-3716-4555-ae17-781836c47144 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d247f90aa5449dbd54a4ea86458f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908836d993404006970ed39a9613b600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:18.402972 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-148846c4-3716-4555-ae17-781836c47144 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] 10.222.0.39 "GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb" status: 200 len: 1214 microversion: 2.1 time: 0.072529 Jul 13 21:16:18.403559 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 557/1134] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:18 2022] GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:16:19.424119 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-8df1ceae-9a0a-4281-86cb-98e098f76bd3 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:19.425657 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8df1ceae-9a0a-4281-86cb-98e098f76bd3 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] [instance: 85532e75-4b13-481c-af2c-f75465a122cb] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:19.496016 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8df1ceae-9a0a-4281-86cb-98e098f76bd3 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d247f90aa5449dbd54a4ea86458f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908836d993404006970ed39a9613b600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:19.506780 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-8df1ceae-9a0a-4281-86cb-98e098f76bd3 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] 10.222.0.39 "GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb" status: 200 len: 1214 microversion: 2.1 time: 0.090023 Jul 13 21:16:19.518815 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 578/1135] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:19 2022] GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb => generated 1214 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:20.525214 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-90fa6c44-1c56-4f93-a362-041e1e3b435b tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:20.525821 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-90fa6c44-1c56-4f93-a362-041e1e3b435b tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] [instance: 85532e75-4b13-481c-af2c-f75465a122cb] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:20.577563 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-90fa6c44-1c56-4f93-a362-041e1e3b435b tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d247f90aa5449dbd54a4ea86458f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908836d993404006970ed39a9613b600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:20.585224 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-90fa6c44-1c56-4f93-a362-041e1e3b435b tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] 10.222.0.39 "GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb" status: 200 len: 1214 microversion: 2.1 time: 0.064458 Jul 13 21:16:20.585776 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 558/1136] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:20 2022] GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:21.601697 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-292d432e-25aa-4be4-b46a-db4d6c5b793a tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:21.602336 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-292d432e-25aa-4be4-b46a-db4d6c5b793a tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] [instance: 85532e75-4b13-481c-af2c-f75465a122cb] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:21.664749 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-292d432e-25aa-4be4-b46a-db4d6c5b793a tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d247f90aa5449dbd54a4ea86458f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908836d993404006970ed39a9613b600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:21.673039 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-292d432e-25aa-4be4-b46a-db4d6c5b793a tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] 10.222.0.39 "GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb" status: 200 len: 1214 microversion: 2.1 time: 0.074970 Jul 13 21:16:21.674562 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 579/1137] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:21 2022] GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:22.692018 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0ba43f2f-7276-497e-aa6a-50f07e2edd25 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:22.692616 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-0ba43f2f-7276-497e-aa6a-50f07e2edd25 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] [instance: 85532e75-4b13-481c-af2c-f75465a122cb] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:22.700795 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0ba43f2f-7276-497e-aa6a-50f07e2edd25 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:22.701240 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0ba43f2f-7276-497e-aa6a-50f07e2edd25 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:22.701992 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0ba43f2f-7276-497e-aa6a-50f07e2edd25 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:22.702423 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0ba43f2f-7276-497e-aa6a-50f07e2edd25 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:22.771488 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-0ba43f2f-7276-497e-aa6a-50f07e2edd25 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d247f90aa5449dbd54a4ea86458f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908836d993404006970ed39a9613b600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:22.779200 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-0ba43f2f-7276-497e-aa6a-50f07e2edd25 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] 10.222.0.39 "GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb" status: 200 len: 1218 microversion: 2.1 time: 0.091174 Jul 13 21:16:22.779752 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 559/1138] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:22 2022] GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:23.795804 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-7cf582a0-ea86-438b-877b-ebad001cefd4 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:23.796455 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-7cf582a0-ea86-438b-877b-ebad001cefd4 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] [instance: 85532e75-4b13-481c-af2c-f75465a122cb] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:23.805179 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7cf582a0-ea86-438b-877b-ebad001cefd4 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:23.805628 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7cf582a0-ea86-438b-877b-ebad001cefd4 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:23.806929 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7cf582a0-ea86-438b-877b-ebad001cefd4 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:23.807371 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7cf582a0-ea86-438b-877b-ebad001cefd4 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:23.880184 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-7cf582a0-ea86-438b-877b-ebad001cefd4 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d247f90aa5449dbd54a4ea86458f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908836d993404006970ed39a9613b600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:23.885458 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-7cf582a0-ea86-438b-877b-ebad001cefd4 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] 10.222.0.39 "GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb" status: 200 len: 1272 microversion: 2.1 time: 0.093537 Jul 13 21:16:23.886028 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 580/1139] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:23 2022] GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb => generated 1272 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:24.902074 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-97d6f2a0-dbf1-4544-b6ab-8a5ffdcf4af2 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:24.902821 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-97d6f2a0-dbf1-4544-b6ab-8a5ffdcf4af2 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] [instance: 85532e75-4b13-481c-af2c-f75465a122cb] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:24.909369 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-97d6f2a0-dbf1-4544-b6ab-8a5ffdcf4af2 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:24.909820 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-97d6f2a0-dbf1-4544-b6ab-8a5ffdcf4af2 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:24.910580 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-97d6f2a0-dbf1-4544-b6ab-8a5ffdcf4af2 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:24.911032 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-97d6f2a0-dbf1-4544-b6ab-8a5ffdcf4af2 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:25.142301 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-97d6f2a0-dbf1-4544-b6ab-8a5ffdcf4af2 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d247f90aa5449dbd54a4ea86458f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908836d993404006970ed39a9613b600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:25.151940 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-97d6f2a0-dbf1-4544-b6ab-8a5ffdcf4af2 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] 10.222.0.39 "GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb" status: 200 len: 1314 microversion: 2.1 time: 0.254182 Jul 13 21:16:25.152748 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 560/1140] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:24 2022] GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:25.720533 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-86e8c181-2c9d-446a-8173-03ef63f696da req-a8df2927-442a-4392-b6c3-39b734135e77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85532e75-4b13-481c-af2c-f75465a122cb", "tag": "c867039f-1197-40f1-9d6d-3e3dc23b05b1"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:16:25.729160 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-86e8c181-2c9d-446a-8173-03ef63f696da req-a8df2927-442a-4392-b6c3-39b734135e77 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:25.729597 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-86e8c181-2c9d-446a-8173-03ef63f696da req-a8df2927-442a-4392-b6c3-39b734135e77 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:25.740565 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-86e8c181-2c9d-446a-8173-03ef63f696da req-a8df2927-442a-4392-b6c3-39b734135e77 service nova] Creating event network-changed:c867039f-1197-40f1-9d6d-3e3dc23b05b1 for instance 85532e75-4b13-481c-af2c-f75465a122cb on hv-cinder-79987 Jul 13 21:16:25.746029 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-86e8c181-2c9d-446a-8173-03ef63f696da req-a8df2927-442a-4392-b6c3-39b734135e77 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.296158 Jul 13 21:16:25.746795 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 581/1141] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:16:26.171074 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0037c681-1d98-4b3a-b166-ebc159dc6caf tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:26.171768 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-0037c681-1d98-4b3a-b166-ebc159dc6caf tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] [instance: 85532e75-4b13-481c-af2c-f75465a122cb] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:26.178152 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0037c681-1d98-4b3a-b166-ebc159dc6caf tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:26.178626 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0037c681-1d98-4b3a-b166-ebc159dc6caf tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:26.179469 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0037c681-1d98-4b3a-b166-ebc159dc6caf tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:26.179971 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0037c681-1d98-4b3a-b166-ebc159dc6caf tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:26.340764 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-0037c681-1d98-4b3a-b166-ebc159dc6caf tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d247f90aa5449dbd54a4ea86458f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908836d993404006970ed39a9613b600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:26.359197 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-0037c681-1d98-4b3a-b166-ebc159dc6caf tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] 10.222.0.39 "GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb" status: 200 len: 1314 microversion: 2.1 time: 0.191806 Jul 13 21:16:26.359998 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 561/1142] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:26 2022] GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:27.374237 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=2 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:16:27.379122 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-cdd03187-95fa-49ee-b3b9-31d47194acaa tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:27.379827 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-cdd03187-95fa-49ee-b3b9-31d47194acaa tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] [instance: 85532e75-4b13-481c-af2c-f75465a122cb] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:27.386561 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-cdd03187-95fa-49ee-b3b9-31d47194acaa tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:27.387031 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-cdd03187-95fa-49ee-b3b9-31d47194acaa tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:27.387797 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-cdd03187-95fa-49ee-b3b9-31d47194acaa tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:27.388230 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-cdd03187-95fa-49ee-b3b9-31d47194acaa tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:27.595066 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-cdd03187-95fa-49ee-b3b9-31d47194acaa tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d247f90aa5449dbd54a4ea86458f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908836d993404006970ed39a9613b600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:27.604154 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-cdd03187-95fa-49ee-b3b9-31d47194acaa tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] 10.222.0.39 "GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb" status: 200 len: 1314 microversion: 2.1 time: 0.231255 Jul 13 21:16:27.604729 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 582/1143] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:27 2022] GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:28.620856 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-a3e6a81c-99e7-408c-a55b-5887d44823e7 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:28.621465 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-a3e6a81c-99e7-408c-a55b-5887d44823e7 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] [instance: 85532e75-4b13-481c-af2c-f75465a122cb] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:28.627884 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a3e6a81c-99e7-408c-a55b-5887d44823e7 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:28.628338 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a3e6a81c-99e7-408c-a55b-5887d44823e7 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:28.629098 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a3e6a81c-99e7-408c-a55b-5887d44823e7 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:28.629536 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-a3e6a81c-99e7-408c-a55b-5887d44823e7 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:28.777002 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-a3e6a81c-99e7-408c-a55b-5887d44823e7 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d247f90aa5449dbd54a4ea86458f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908836d993404006970ed39a9613b600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:28.797975 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-a3e6a81c-99e7-408c-a55b-5887d44823e7 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] 10.222.0.39 "GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb" status: 200 len: 1314 microversion: 2.1 time: 0.180807 Jul 13 21:16:28.798666 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 562/1144] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:28 2022] GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:29.814838 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-a91090e5-c907-44e2-b70a-dcf16ea062b4 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:29.815382 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-a91090e5-c907-44e2-b70a-dcf16ea062b4 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] [instance: 85532e75-4b13-481c-af2c-f75465a122cb] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:29.821647 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a91090e5-c907-44e2-b70a-dcf16ea062b4 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:29.822187 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a91090e5-c907-44e2-b70a-dcf16ea062b4 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:29.823060 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a91090e5-c907-44e2-b70a-dcf16ea062b4 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:29.823507 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a91090e5-c907-44e2-b70a-dcf16ea062b4 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:29.950840 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-a91090e5-c907-44e2-b70a-dcf16ea062b4 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d247f90aa5449dbd54a4ea86458f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908836d993404006970ed39a9613b600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:29.958111 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-a91090e5-c907-44e2-b70a-dcf16ea062b4 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] 10.222.0.39 "GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb" status: 200 len: 1314 microversion: 2.1 time: 0.147221 Jul 13 21:16:29.958689 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 583/1145] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:29 2022] GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:30.975727 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-eaee50fe-c79e-4db5-a73b-bb2e3fe45326 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:30.976410 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-eaee50fe-c79e-4db5-a73b-bb2e3fe45326 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] [instance: 85532e75-4b13-481c-af2c-f75465a122cb] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:30.979179 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell0:SELECT=4 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:16:30.984684 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eaee50fe-c79e-4db5-a73b-bb2e3fe45326 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:30.985132 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eaee50fe-c79e-4db5-a73b-bb2e3fe45326 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:30.985926 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eaee50fe-c79e-4db5-a73b-bb2e3fe45326 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:30.986359 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-eaee50fe-c79e-4db5-a73b-bb2e3fe45326 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:31.115541 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-eaee50fe-c79e-4db5-a73b-bb2e3fe45326 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d247f90aa5449dbd54a4ea86458f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908836d993404006970ed39a9613b600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:31.125604 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-eaee50fe-c79e-4db5-a73b-bb2e3fe45326 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] 10.222.0.39 "GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb" status: 200 len: 1314 microversion: 2.1 time: 0.153668 Jul 13 21:16:31.126179 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 563/1146] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:30 2022] GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:32.143747 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-7e6b822f-5fb9-429f-b378-d99e5b45f27e tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:32.144361 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-7e6b822f-5fb9-429f-b378-d99e5b45f27e tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] [instance: 85532e75-4b13-481c-af2c-f75465a122cb] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:32.146852 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=10 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:16:32.152270 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7e6b822f-5fb9-429f-b378-d99e5b45f27e tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:32.152717 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7e6b822f-5fb9-429f-b378-d99e5b45f27e tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:32.153474 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7e6b822f-5fb9-429f-b378-d99e5b45f27e tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:32.153902 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-7e6b822f-5fb9-429f-b378-d99e5b45f27e tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:32.298852 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-7e6b822f-5fb9-429f-b378-d99e5b45f27e tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d247f90aa5449dbd54a4ea86458f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908836d993404006970ed39a9613b600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:32.307067 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-7e6b822f-5fb9-429f-b378-d99e5b45f27e tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] 10.222.0.39 "GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb" status: 200 len: 1314 microversion: 2.1 time: 0.167991 Jul 13 21:16:32.307639 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 584/1147] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:32 2022] GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:33.054836 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-bca99025-692e-4650-aed4-e3a287a7499a tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1241981462", "imageRef": "5a995c88-d784-4a51-a6b9-25aa9dfe607c", "flavorRef": "452", "networks": [{"uuid": "5068c946-beb1-431b-9723-d5006ec91fba"}]}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:16:33.108086 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.network.neutron [None req-bca99025-692e-4650-aed4-e3a287a7499a tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] validate_networks() for [('5068c946-beb1-431b-9723-d5006ec91fba', None, None, None, None, None)] {{(pid=118444) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 21:16:33.324727 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-504237d7-89cc-4245-bcd2-433663f7136a tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:33.325448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-504237d7-89cc-4245-bcd2-433663f7136a tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] [instance: 85532e75-4b13-481c-af2c-f75465a122cb] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:33.332025 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-504237d7-89cc-4245-bcd2-433663f7136a tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:33.332507 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-504237d7-89cc-4245-bcd2-433663f7136a tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:33.333438 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-504237d7-89cc-4245-bcd2-433663f7136a tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:33.333882 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-504237d7-89cc-4245-bcd2-433663f7136a tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:33.479571 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-504237d7-89cc-4245-bcd2-433663f7136a tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d247f90aa5449dbd54a4ea86458f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908836d993404006970ed39a9613b600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:33.490419 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-504237d7-89cc-4245-bcd2-433663f7136a tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] 10.222.0.39 "GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb" status: 200 len: 1314 microversion: 2.1 time: 0.169595 Jul 13 21:16:33.491625 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 585/1148] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:33 2022] GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:33.551843 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.virt.hardware [None req-bca99025-692e-4650-aed4-e3a287a7499a tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Flavor limits 0:0:0 {{(pid=118444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 21:16:33.552482 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.virt.hardware [None req-bca99025-692e-4650-aed4-e3a287a7499a tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Image limits 0:0:0 {{(pid=118444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 21:16:33.553028 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.virt.hardware [None req-bca99025-692e-4650-aed4-e3a287a7499a tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Flavor pref 0:0:0 {{(pid=118444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 21:16:33.553643 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.virt.hardware [None req-bca99025-692e-4650-aed4-e3a287a7499a tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Image pref 0:0:0 {{(pid=118444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 21:16:33.554222 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.virt.hardware [None req-bca99025-692e-4650-aed4-e3a287a7499a tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 21:16:33.563708 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bca99025-692e-4650-aed4-e3a287a7499a tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:33.564150 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bca99025-692e-4650-aed4-e3a287a7499a tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:33.564939 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bca99025-692e-4650-aed4-e3a287a7499a tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:33.565371 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bca99025-692e-4650-aed4-e3a287a7499a tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:33.584793 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.quota [None req-bca99025-692e-4650-aed4-e3a287a7499a tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Getting quotas for project ac44f6fd5247482cab9e535fbecdf2b8. Resources: {'cores', 'instances', 'ram'} {{(pid=118444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:16:33.595345 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.quota [None req-bca99025-692e-4650-aed4-e3a287a7499a tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Getting quotas for user dd25dfa539c94951a59574fd9d2591bb and project ac44f6fd5247482cab9e535fbecdf2b8. Resources: {'cores', 'instances', 'ram'} {{(pid=118444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:16:33.606927 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-bca99025-692e-4650-aed4-e3a287a7499a tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Going to run 1 instances... {{(pid=118444) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 21:16:33.609201 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-bca99025-692e-4650-aed4-e3a287a7499a tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 84801551-4737-4cc5-b7af-2199c3e8a738] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995c88-d784-4a51-a6b9-25aa9dfe607c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 21:16:33.652775 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-bca99025-692e-4650-aed4-e3a287a7499a tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601811 Jul 13 21:16:33.653413 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 564/1149] 10.222.0.39 () {60 vars in 1146 bytes} [Wed Jul 13 21:16:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 21:16:33.663426 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-1908229e-860d-4573-834f-ee1bc62fd368 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:33.664037 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-1908229e-860d-4573-834f-ee1bc62fd368 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 84801551-4737-4cc5-b7af-2199c3e8a738] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:33.718490 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-1908229e-860d-4573-834f-ee1bc62fd368 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd25dfa539c94951a59574fd9d2591bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac44f6fd5247482cab9e535fbecdf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:33.725219 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-1908229e-860d-4573-834f-ee1bc62fd368 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738" status: 200 len: 1214 microversion: 2.1 time: 0.065568 Jul 13 21:16:33.725784 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 586/1150] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:33 2022] GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:34.510604 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-88ea53a0-f84c-463f-9ae2-1b8705cc394e tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:34.511213 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-88ea53a0-f84c-463f-9ae2-1b8705cc394e tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] [instance: 85532e75-4b13-481c-af2c-f75465a122cb] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:34.517923 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-88ea53a0-f84c-463f-9ae2-1b8705cc394e tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:34.518351 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-88ea53a0-f84c-463f-9ae2-1b8705cc394e tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:34.519132 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-88ea53a0-f84c-463f-9ae2-1b8705cc394e tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:34.519574 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-88ea53a0-f84c-463f-9ae2-1b8705cc394e tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:34.742739 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-3c7f1e0e-271d-4157-a9b4-51a74fa3b1f4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:34.743426 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-3c7f1e0e-271d-4157-a9b4-51a74fa3b1f4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 84801551-4737-4cc5-b7af-2199c3e8a738] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:34.753572 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3c7f1e0e-271d-4157-a9b4-51a74fa3b1f4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:34.754018 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3c7f1e0e-271d-4157-a9b4-51a74fa3b1f4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:34.762524 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3c7f1e0e-271d-4157-a9b4-51a74fa3b1f4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:34.763448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-3c7f1e0e-271d-4157-a9b4-51a74fa3b1f4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:34.765544 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-88ea53a0-f84c-463f-9ae2-1b8705cc394e tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d247f90aa5449dbd54a4ea86458f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908836d993404006970ed39a9613b600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:34.775417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-88ea53a0-f84c-463f-9ae2-1b8705cc394e tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] 10.222.0.39 "GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb" status: 200 len: 1314 microversion: 2.1 time: 0.270007 Jul 13 21:16:34.780486 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 565/1151] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:34 2022] GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:34.853784 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-3c7f1e0e-271d-4157-a9b4-51a74fa3b1f4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd25dfa539c94951a59574fd9d2591bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac44f6fd5247482cab9e535fbecdf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:34.865608 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-3c7f1e0e-271d-4157-a9b4-51a74fa3b1f4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738" status: 200 len: 1272 microversion: 2.1 time: 0.126808 Jul 13 21:16:34.866706 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 587/1152] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:34 2022] GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738 => generated 1272 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:16:34.980575 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-47afc688-eb5e-4c59-925e-f0a655147887 req-98977dd5-72e3-4cae-8fc4-8a9a07eccb29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85532e75-4b13-481c-af2c-f75465a122cb", "name": "network-vif-plugged", "status": "completed", "tag": "c867039f-1197-40f1-9d6d-3e3dc23b05b1"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:16:34.988884 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-47afc688-eb5e-4c59-925e-f0a655147887 req-98977dd5-72e3-4cae-8fc4-8a9a07eccb29 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:34.989323 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-47afc688-eb5e-4c59-925e-f0a655147887 req-98977dd5-72e3-4cae-8fc4-8a9a07eccb29 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:35.001718 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-47afc688-eb5e-4c59-925e-f0a655147887 req-98977dd5-72e3-4cae-8fc4-8a9a07eccb29 service nova] Creating event network-vif-plugged:c867039f-1197-40f1-9d6d-3e3dc23b05b1 for instance 85532e75-4b13-481c-af2c-f75465a122cb on hv-cinder-79987 Jul 13 21:16:35.006860 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-47afc688-eb5e-4c59-925e-f0a655147887 req-98977dd5-72e3-4cae-8fc4-8a9a07eccb29 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211327 Jul 13 21:16:35.007498 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 566/1153] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:16:35.792524 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-35f08c79-8e4a-4bda-b5ec-f8a0417914f4 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:35.793133 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-35f08c79-8e4a-4bda-b5ec-f8a0417914f4 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] [instance: 85532e75-4b13-481c-af2c-f75465a122cb] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:35.799771 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-35f08c79-8e4a-4bda-b5ec-f8a0417914f4 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:35.800214 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-35f08c79-8e4a-4bda-b5ec-f8a0417914f4 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:35.800982 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-35f08c79-8e4a-4bda-b5ec-f8a0417914f4 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:35.801423 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-35f08c79-8e4a-4bda-b5ec-f8a0417914f4 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:35.883861 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-4365db1d-bbb8-40cd-9e52-e2e165057803 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:35.885468 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-4365db1d-bbb8-40cd-9e52-e2e165057803 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 84801551-4737-4cc5-b7af-2199c3e8a738] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:35.891941 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4365db1d-bbb8-40cd-9e52-e2e165057803 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:35.892217 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4365db1d-bbb8-40cd-9e52-e2e165057803 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:35.893153 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4365db1d-bbb8-40cd-9e52-e2e165057803 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:35.893786 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4365db1d-bbb8-40cd-9e52-e2e165057803 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:35.934501 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-35f08c79-8e4a-4bda-b5ec-f8a0417914f4 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d247f90aa5449dbd54a4ea86458f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908836d993404006970ed39a9613b600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:35.943020 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-35f08c79-8e4a-4bda-b5ec-f8a0417914f4 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] 10.222.0.39 "GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb" status: 200 len: 1314 microversion: 2.1 time: 0.154952 Jul 13 21:16:35.947109 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 588/1154] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:35 2022] GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:36.117682 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-4365db1d-bbb8-40cd-9e52-e2e165057803 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd25dfa539c94951a59574fd9d2591bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac44f6fd5247482cab9e535fbecdf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:36.125385 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-4365db1d-bbb8-40cd-9e52-e2e165057803 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738" status: 200 len: 1314 microversion: 2.1 time: 0.246162 Jul 13 21:16:36.133611 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 567/1155] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:35 2022] GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:36.471075 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-1e980938-f0f6-4aba-81d0-4a440e39802d req-64e232d6-495e-47d4-b6cc-ee495e126396 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84801551-4737-4cc5-b7af-2199c3e8a738", "tag": "40c6a509-485d-4651-984f-2d19a0b17157"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:16:36.480854 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-1e980938-f0f6-4aba-81d0-4a440e39802d req-64e232d6-495e-47d4-b6cc-ee495e126396 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:36.481329 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-1e980938-f0f6-4aba-81d0-4a440e39802d req-64e232d6-495e-47d4-b6cc-ee495e126396 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:36.494211 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-1e980938-f0f6-4aba-81d0-4a440e39802d req-64e232d6-495e-47d4-b6cc-ee495e126396 service nova] Creating event network-changed:40c6a509-485d-4651-984f-2d19a0b17157 for instance 84801551-4737-4cc5-b7af-2199c3e8a738 on hv-cinder-79987 Jul 13 21:16:36.500626 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-1e980938-f0f6-4aba-81d0-4a440e39802d req-64e232d6-495e-47d4-b6cc-ee495e126396 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033200 Jul 13 21:16:36.501223 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 589/1156] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:16:36.959896 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ff79fa8c-690b-4820-b19b-85824a3e2c70 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:36.960493 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-ff79fa8c-690b-4820-b19b-85824a3e2c70 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] [instance: 85532e75-4b13-481c-af2c-f75465a122cb] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:36.967177 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ff79fa8c-690b-4820-b19b-85824a3e2c70 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:36.967620 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ff79fa8c-690b-4820-b19b-85824a3e2c70 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:36.968395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ff79fa8c-690b-4820-b19b-85824a3e2c70 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:36.968806 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ff79fa8c-690b-4820-b19b-85824a3e2c70 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:37.145599 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-97beee19-b55d-467a-9add-32c9b4f7dea5 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:37.147066 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-97beee19-b55d-467a-9add-32c9b4f7dea5 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 84801551-4737-4cc5-b7af-2199c3e8a738] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:37.154768 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-97beee19-b55d-467a-9add-32c9b4f7dea5 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:37.155394 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-97beee19-b55d-467a-9add-32c9b4f7dea5 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:37.156359 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-97beee19-b55d-467a-9add-32c9b4f7dea5 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:37.156952 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-97beee19-b55d-467a-9add-32c9b4f7dea5 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:37.202272 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ff79fa8c-690b-4820-b19b-85824a3e2c70 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d247f90aa5449dbd54a4ea86458f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908836d993404006970ed39a9613b600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:37.217410 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ff79fa8c-690b-4820-b19b-85824a3e2c70 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] 10.222.0.39 "GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb" status: 200 len: 1314 microversion: 2.1 time: 0.260718 Jul 13 21:16:37.220367 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 568/1157] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:36 2022] GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:37.304360 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-97beee19-b55d-467a-9add-32c9b4f7dea5 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd25dfa539c94951a59574fd9d2591bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac44f6fd5247482cab9e535fbecdf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:37.313146 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-97beee19-b55d-467a-9add-32c9b4f7dea5 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738" status: 200 len: 1314 microversion: 2.1 time: 0.174430 Jul 13 21:16:37.315376 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 590/1158] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:37 2022] GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:38.242181 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-f70ba32a-57c9-408f-a538-c7c232160093 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:38.242800 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-f70ba32a-57c9-408f-a538-c7c232160093 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] [instance: 85532e75-4b13-481c-af2c-f75465a122cb] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:38.249835 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f70ba32a-57c9-408f-a538-c7c232160093 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:38.250275 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f70ba32a-57c9-408f-a538-c7c232160093 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:38.251048 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f70ba32a-57c9-408f-a538-c7c232160093 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:38.251481 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f70ba32a-57c9-408f-a538-c7c232160093 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:38.331698 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-01643ea9-29d5-4d58-bcca-5777ab23e0f9 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:38.332304 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-01643ea9-29d5-4d58-bcca-5777ab23e0f9 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 84801551-4737-4cc5-b7af-2199c3e8a738] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:38.338992 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-01643ea9-29d5-4d58-bcca-5777ab23e0f9 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:38.339433 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-01643ea9-29d5-4d58-bcca-5777ab23e0f9 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:38.340187 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-01643ea9-29d5-4d58-bcca-5777ab23e0f9 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:38.340649 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-01643ea9-29d5-4d58-bcca-5777ab23e0f9 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:38.392717 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f70ba32a-57c9-408f-a538-c7c232160093 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d247f90aa5449dbd54a4ea86458f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908836d993404006970ed39a9613b600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:38.400149 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-f70ba32a-57c9-408f-a538-c7c232160093 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] 10.222.0.39 "GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb" status: 200 len: 1464 microversion: 2.1 time: 0.161739 Jul 13 21:16:38.400708 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 569/1159] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:38 2022] GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb => generated 1464 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:38.441332 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-4bd36f23-5f0f-4f7f-a671-4e61e4b4d16d tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:38.441888 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-4bd36f23-5f0f-4f7f-a671-4e61e4b4d16d tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] [instance: 85532e75-4b13-481c-af2c-f75465a122cb] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:38.447933 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4bd36f23-5f0f-4f7f-a671-4e61e4b4d16d tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:38.448383 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4bd36f23-5f0f-4f7f-a671-4e61e4b4d16d tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:38.449261 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4bd36f23-5f0f-4f7f-a671-4e61e4b4d16d tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:38.449706 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4bd36f23-5f0f-4f7f-a671-4e61e4b4d16d tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:38.473672 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-4bd36f23-5f0f-4f7f-a671-4e61e4b4d16d tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] [instance: 85532e75-4b13-481c-af2c-f75465a122cb] Going to try to terminate instance {{(pid=118444) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 21:16:38.476401 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-01643ea9-29d5-4d58-bcca-5777ab23e0f9 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd25dfa539c94951a59574fd9d2591bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac44f6fd5247482cab9e535fbecdf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:38.485770 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-01643ea9-29d5-4d58-bcca-5777ab23e0f9 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738" status: 200 len: 1314 microversion: 2.1 time: 0.157807 Jul 13 21:16:38.487031 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 591/1160] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:38 2022] GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:16:38.553244 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-4bd36f23-5f0f-4f7f-a671-4e61e4b4d16d tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] 10.222.0.39 "DELETE /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb" status: 204 len: 0 microversion: 2.1 time: 0.115633 Jul 13 21:16:38.553816 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 570/1161] 10.222.0.39 () {58 vars in 1238 bytes} [Wed Jul 13 21:16:38 2022] DELETE /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 13 21:16:38.562634 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-93831bc1-ffd2-4981-ba8b-d89f36e60816 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:38.563257 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-93831bc1-ffd2-4981-ba8b-d89f36e60816 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] [instance: 85532e75-4b13-481c-af2c-f75465a122cb] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:38.569177 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-93831bc1-ffd2-4981-ba8b-d89f36e60816 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:38.569620 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-93831bc1-ffd2-4981-ba8b-d89f36e60816 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:38.570381 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-93831bc1-ffd2-4981-ba8b-d89f36e60816 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:38.570846 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-93831bc1-ffd2-4981-ba8b-d89f36e60816 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:38.699497 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-93831bc1-ffd2-4981-ba8b-d89f36e60816 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d247f90aa5449dbd54a4ea86458f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908836d993404006970ed39a9613b600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:38.709118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-93831bc1-ffd2-4981-ba8b-d89f36e60816 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] 10.222.0.39 "GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb" status: 200 len: 1470 microversion: 2.1 time: 0.150199 Jul 13 21:16:38.710491 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 592/1162] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:38 2022] GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:39.505757 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-9eac94b2-12ac-4def-9d9b-9816c3ddbb5d tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:39.506443 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-9eac94b2-12ac-4def-9d9b-9816c3ddbb5d tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 84801551-4737-4cc5-b7af-2199c3e8a738] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:39.514032 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9eac94b2-12ac-4def-9d9b-9816c3ddbb5d tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:39.514477 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9eac94b2-12ac-4def-9d9b-9816c3ddbb5d tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:39.515274 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9eac94b2-12ac-4def-9d9b-9816c3ddbb5d tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:39.515708 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9eac94b2-12ac-4def-9d9b-9816c3ddbb5d tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:39.656714 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-9eac94b2-12ac-4def-9d9b-9816c3ddbb5d tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd25dfa539c94951a59574fd9d2591bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac44f6fd5247482cab9e535fbecdf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:39.664101 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-9eac94b2-12ac-4def-9d9b-9816c3ddbb5d tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738" status: 200 len: 1314 microversion: 2.1 time: 0.162487 Jul 13 21:16:39.664648 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 571/1163] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:39 2022] GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:39.728525 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-cdb60c39-bab2-4157-93c2-1826ec225040 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:39.729126 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-cdb60c39-bab2-4157-93c2-1826ec225040 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] [instance: 85532e75-4b13-481c-af2c-f75465a122cb] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:39.735607 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-cdb60c39-bab2-4157-93c2-1826ec225040 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:39.736053 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-cdb60c39-bab2-4157-93c2-1826ec225040 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:39.736818 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-cdb60c39-bab2-4157-93c2-1826ec225040 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:39.737249 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-cdb60c39-bab2-4157-93c2-1826ec225040 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:39.868210 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-cdb60c39-bab2-4157-93c2-1826ec225040 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d247f90aa5449dbd54a4ea86458f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908836d993404006970ed39a9613b600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:39.876166 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-cdb60c39-bab2-4157-93c2-1826ec225040 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] 10.222.0.39 "GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb" status: 200 len: 1470 microversion: 2.1 time: 0.152018 Jul 13 21:16:39.876710 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 593/1164] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:39 2022] GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:40.680677 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-602f8157-e9c3-4f21-b558-06251914e672 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:40.681295 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-602f8157-e9c3-4f21-b558-06251914e672 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 84801551-4737-4cc5-b7af-2199c3e8a738] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:40.687685 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-602f8157-e9c3-4f21-b558-06251914e672 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:40.688176 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-602f8157-e9c3-4f21-b558-06251914e672 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:40.688936 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-602f8157-e9c3-4f21-b558-06251914e672 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:40.689376 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-602f8157-e9c3-4f21-b558-06251914e672 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:40.893972 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-2eba20d7-ba7c-4508-ba82-3214025709dc tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:40.894685 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-2eba20d7-ba7c-4508-ba82-3214025709dc tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] [instance: 85532e75-4b13-481c-af2c-f75465a122cb] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:40.901165 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2eba20d7-ba7c-4508-ba82-3214025709dc tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:40.901685 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2eba20d7-ba7c-4508-ba82-3214025709dc tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:40.902537 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2eba20d7-ba7c-4508-ba82-3214025709dc tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:40.903083 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2eba20d7-ba7c-4508-ba82-3214025709dc tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:40.907664 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-602f8157-e9c3-4f21-b558-06251914e672 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd25dfa539c94951a59574fd9d2591bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac44f6fd5247482cab9e535fbecdf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:40.916043 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-602f8157-e9c3-4f21-b558-06251914e672 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738" status: 200 len: 1314 microversion: 2.1 time: 0.238712 Jul 13 21:16:40.917742 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 572/1165] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:40 2022] GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:41.043856 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-2eba20d7-ba7c-4508-ba82-3214025709dc tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d247f90aa5449dbd54a4ea86458f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908836d993404006970ed39a9613b600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:41.051250 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-2eba20d7-ba7c-4508-ba82-3214025709dc tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] 10.222.0.39 "GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb" status: 200 len: 1470 microversion: 2.1 time: 0.161907 Jul 13 21:16:41.051809 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 594/1166] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:40 2022] GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:41.804113 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-dd8b3321-5135-4385-9542-57be10ac781d req-e9ecd72c-f66a-49ee-8e76-efda7a41d1db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85532e75-4b13-481c-af2c-f75465a122cb", "name": "network-vif-deleted", "tag": "c867039f-1197-40f1-9d6d-3e3dc23b05b1"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:16:41.813571 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-dd8b3321-5135-4385-9542-57be10ac781d req-e9ecd72c-f66a-49ee-8e76-efda7a41d1db service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:41.814011 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-dd8b3321-5135-4385-9542-57be10ac781d req-e9ecd72c-f66a-49ee-8e76-efda7a41d1db service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:41.825897 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-dd8b3321-5135-4385-9542-57be10ac781d req-e9ecd72c-f66a-49ee-8e76-efda7a41d1db service nova] Creating event network-vif-deleted:c867039f-1197-40f1-9d6d-3e3dc23b05b1 for instance 85532e75-4b13-481c-af2c-f75465a122cb on hv-cinder-79987 Jul 13 21:16:41.831513 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-dd8b3321-5135-4385-9542-57be10ac781d req-e9ecd72c-f66a-49ee-8e76-efda7a41d1db service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030999 Jul 13 21:16:41.832096 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 573/1167] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:16:41.938274 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-5f7a3fa9-9172-43ed-94cb-11ed93617e65 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:41.938919 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-5f7a3fa9-9172-43ed-94cb-11ed93617e65 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 84801551-4737-4cc5-b7af-2199c3e8a738] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:41.946240 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5f7a3fa9-9172-43ed-94cb-11ed93617e65 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:41.947351 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5f7a3fa9-9172-43ed-94cb-11ed93617e65 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:41.948289 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5f7a3fa9-9172-43ed-94cb-11ed93617e65 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:41.949346 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5f7a3fa9-9172-43ed-94cb-11ed93617e65 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:42.068296 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-edcd0066-9b33-469d-b3f2-9a142a5ffa99 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:42.068938 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-edcd0066-9b33-469d-b3f2-9a142a5ffa99 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] [instance: 85532e75-4b13-481c-af2c-f75465a122cb] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:42.075516 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-edcd0066-9b33-469d-b3f2-9a142a5ffa99 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:42.075973 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-edcd0066-9b33-469d-b3f2-9a142a5ffa99 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:42.076736 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-edcd0066-9b33-469d-b3f2-9a142a5ffa99 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:42.077170 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-edcd0066-9b33-469d-b3f2-9a142a5ffa99 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:42.084762 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5f7a3fa9-9172-43ed-94cb-11ed93617e65 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd25dfa539c94951a59574fd9d2591bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac44f6fd5247482cab9e535fbecdf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:42.092175 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-5f7a3fa9-9172-43ed-94cb-11ed93617e65 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738" status: 200 len: 1314 microversion: 2.1 time: 0.158006 Jul 13 21:16:42.092730 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 595/1168] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:41 2022] GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:42.108172 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-edcd0066-9b33-469d-b3f2-9a142a5ffa99 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:42.108636 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-edcd0066-9b33-469d-b3f2-9a142a5ffa99 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:42.109071 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.objects.instance [None req-edcd0066-9b33-469d-b3f2-9a142a5ffa99 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lazy-loading 'fault' on Instance uuid 85532e75-4b13-481c-af2c-f75465a122cb {{(pid=118444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:16:42.152278 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-edcd0066-9b33-469d-b3f2-9a142a5ffa99 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d247f90aa5449dbd54a4ea86458f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908836d993404006970ed39a9613b600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:42.159738 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-edcd0066-9b33-469d-b3f2-9a142a5ffa99 tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] 10.222.0.39 "GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb" status: 200 len: 1304 microversion: 2.1 time: 0.095697 Jul 13 21:16:42.160294 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 574/1169] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:42 2022] GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:16:43.109669 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-1e12bce3-b8af-4236-8bda-1da859bb09e1 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:43.110264 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-1e12bce3-b8af-4236-8bda-1da859bb09e1 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 84801551-4737-4cc5-b7af-2199c3e8a738] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:43.116783 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1e12bce3-b8af-4236-8bda-1da859bb09e1 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:43.117221 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1e12bce3-b8af-4236-8bda-1da859bb09e1 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:43.117966 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1e12bce3-b8af-4236-8bda-1da859bb09e1 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:43.118391 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1e12bce3-b8af-4236-8bda-1da859bb09e1 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:43.177226 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-d0cd0cc6-23fa-417f-855d-281d09f9374a tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:43.177832 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-d0cd0cc6-23fa-417f-855d-281d09f9374a tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] [instance: 85532e75-4b13-481c-af2c-f75465a122cb] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:43.185232 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d0cd0cc6-23fa-417f-855d-281d09f9374a tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:43.185683 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d0cd0cc6-23fa-417f-855d-281d09f9374a tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:43.186454 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d0cd0cc6-23fa-417f-855d-281d09f9374a tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:43.186946 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-d0cd0cc6-23fa-417f-855d-281d09f9374a tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:43.203318 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.wsgi [None req-d0cd0cc6-23fa-417f-855d-281d09f9374a tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] HTTP exception thrown: Instance 85532e75-4b13-481c-af2c-f75465a122cb could not be found. Jul 13 21:16:43.204944 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-d0cd0cc6-23fa-417f-855d-281d09f9374a tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Request method failure captured: Jul 13 21:16:43.204944 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: request: GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb HTTP/1.1 Jul 13 21:16:43.204944 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept: application/json Jul 13 21:16:43.204944 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept-Encoding: identity Jul 13 21:16:43.204944 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Connection: close Jul 13 21:16:43.204944 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Length: 0 Jul 13 21:16:43.204944 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Type: application/json Jul 13 21:16:43.204944 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Host: 10.222.0.39 Jul 13 21:16:43.204944 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Openstack-System-Scope: None Jul 13 21:16:43.204944 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: User-Agent: python-urllib3/1.26.9 Jul 13 21:16:43.204944 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Auth-Token: gAAAAABizzYeoKVztefyQUhULzGJ1D8M7C8Ds-3wCGbi4lrLeK__IjRL0GGhkDLUQhJCqq9HY0MjfiavFO2bK21HIYCG1iSjofoOp6L9qwt62wyznl4qVkcMBL71HSCvQ61kA-h6jIbiWfmyYgkzN63WTg5m9l11IicAYt_vFL404EGl-MUXMQI Jul 13 21:16:43.204944 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Id: None Jul 13 21:16:43.204944 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Name: None Jul 13 21:16:43.204944 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Identity-Status: Confirmed Jul 13 21:16:43.204944 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Is-Admin-Project: True Jul 13 21:16:43.204944 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Id: default Jul 13 21:16:43.204944 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Name: Default Jul 13 21:16:43.204944 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Id: 908836d993404006970ed39a9613b600 Jul 13 21:16:43.204944 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Name: tempest-VolumesNegativeTest-1024806638 Jul 13 21:16:43.204944 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Role: member,reader Jul 13 21:16:43.204944 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Roles: member,reader Jul 13 21:16:43.206663 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/908836d993404006970ed39a9613b600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/908836d993404006970ed39a9613b600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_908836d993404006970ed39a9613b600", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/908836d993404006970ed39a9613b600"}]}] Jul 13 21:16:43.206663 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant: tempest-VolumesNegativeTest-1024806638 Jul 13 21:16:43.206663 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Id: 908836d993404006970ed39a9613b600 Jul 13 21:16:43.206663 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Name: tempest-VolumesNegativeTest-1024806638 Jul 13 21:16:43.206663 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User: tempest-VolumesNegativeTest-1024806638-project Jul 13 21:16:43.206663 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Id: default Jul 13 21:16:43.206663 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Name: Default Jul 13 21:16:43.206663 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Id: 96d247f90aa5449dbd54a4ea86458f17 Jul 13 21:16:43.206663 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Name: tempest-VolumesNegativeTest-1024806638-project Jul 13 21:16:43.206663 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: method: > Jul 13 21:16:43.206663 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: exception: Instance 85532e75-4b13-481c-af2c-f75465a122cb could not be found. Jul 13 21:16:43.206663 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: action_args: {'id': '85532e75-4b13-481c-af2c-f75465a122cb'} Jul 13 21:16:43.207664 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:16:43.207664 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:16:43.207664 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:16:43.207664 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:16:43.207664 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:16:43.207664 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:16:43.207664 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:16:43.207664 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:16:43.207664 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:16:43.207664 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:16:43.207664 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85532e75-4b13-481c-af2c-f75465a122cb could not be found. Jul 13 21:16:43.207664 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:16:43.207664 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:16:43.207664 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:16:43.207664 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:16:43.207664 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:16:43.207664 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:16:43.207664 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:16:43.207664 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:16:43.207664 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:16:43.209030 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:16:43.209030 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 21:16:43.209030 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 21:16:43.209030 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:16:43.209030 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:16:43.209030 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:16:43.209030 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:16:43.209030 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85532e75-4b13-481c-af2c-f75465a122cb could not be found. Jul 13 21:16:43.209030 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:16:43.209030 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:16:43.209030 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:16:43.209030 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:16:43.209030 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:16:43.209030 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:16:43.209030 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:16:43.209030 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:16:43.209030 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85532e75-4b13-481c-af2c-f75465a122cb could not be found. Jul 13 21:16:43.209030 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:16:43.210331 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-d0cd0cc6-23fa-417f-855d-281d09f9374a tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] Returning 404 to user: Instance 85532e75-4b13-481c-af2c-f75465a122cb could not be found. {{(pid=118444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:16:43.210331 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-d0cd0cc6-23fa-417f-855d-281d09f9374a tempest-VolumesNegativeTest-1024806638 tempest-VolumesNegativeTest-1024806638-project] 10.222.0.39 "GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb" status: 404 len: 111 microversion: 2.1 time: 0.032950 Jul 13 21:16:43.210331 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 575/1170] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:43 2022] GET /compute/v2.1/servers/85532e75-4b13-481c-af2c-f75465a122cb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 13 21:16:43.266116 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-1e12bce3-b8af-4236-8bda-1da859bb09e1 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd25dfa539c94951a59574fd9d2591bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac44f6fd5247482cab9e535fbecdf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:43.276428 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-1e12bce3-b8af-4236-8bda-1da859bb09e1 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738" status: 200 len: 1314 microversion: 2.1 time: 0.170656 Jul 13 21:16:43.279670 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 596/1171] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:43 2022] GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:44.293088 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-54c6175f-86e2-4d48-94e6-8931008884a1 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:44.293684 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-54c6175f-86e2-4d48-94e6-8931008884a1 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 84801551-4737-4cc5-b7af-2199c3e8a738] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:44.295664 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell0:SELECT=2 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:16:44.300274 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell0:SELECT=6 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:16:44.306382 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-54c6175f-86e2-4d48-94e6-8931008884a1 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:44.306859 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-54c6175f-86e2-4d48-94e6-8931008884a1 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:44.307629 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-54c6175f-86e2-4d48-94e6-8931008884a1 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:44.308065 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-54c6175f-86e2-4d48-94e6-8931008884a1 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:44.312169 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:16:44.460619 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-54c6175f-86e2-4d48-94e6-8931008884a1 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd25dfa539c94951a59574fd9d2591bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac44f6fd5247482cab9e535fbecdf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:44.468640 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-54c6175f-86e2-4d48-94e6-8931008884a1 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738" status: 200 len: 1314 microversion: 2.1 time: 0.179307 Jul 13 21:16:44.469340 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 576/1172] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:44 2022] GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:44.778913 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-60a353c1-c10b-47df-810f-dd270ae5f2ae req-62faa66a-3485-4e2c-ae75-48980e62cc3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84801551-4737-4cc5-b7af-2199c3e8a738", "name": "network-vif-plugged", "status": "completed", "tag": "40c6a509-485d-4651-984f-2d19a0b17157"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:16:44.778913 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=2 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:16:44.793760 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-60a353c1-c10b-47df-810f-dd270ae5f2ae req-62faa66a-3485-4e2c-ae75-48980e62cc3d service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:44.794401 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-60a353c1-c10b-47df-810f-dd270ae5f2ae req-62faa66a-3485-4e2c-ae75-48980e62cc3d service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:44.808620 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-60a353c1-c10b-47df-810f-dd270ae5f2ae req-62faa66a-3485-4e2c-ae75-48980e62cc3d service nova] Creating event network-vif-plugged:40c6a509-485d-4651-984f-2d19a0b17157 for instance 84801551-4737-4cc5-b7af-2199c3e8a738 on hv-cinder-79987 Jul 13 21:16:44.814220 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-60a353c1-c10b-47df-810f-dd270ae5f2ae req-62faa66a-3485-4e2c-ae75-48980e62cc3d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042616 Jul 13 21:16:44.814850 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 597/1173] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:16:45.486189 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-43d2d667-8bd4-4f19-86b5-926e8f8837f4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:45.486817 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-43d2d667-8bd4-4f19-86b5-926e8f8837f4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 84801551-4737-4cc5-b7af-2199c3e8a738] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:45.493336 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-43d2d667-8bd4-4f19-86b5-926e8f8837f4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:45.493785 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-43d2d667-8bd4-4f19-86b5-926e8f8837f4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:45.494538 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-43d2d667-8bd4-4f19-86b5-926e8f8837f4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:45.495003 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-43d2d667-8bd4-4f19-86b5-926e8f8837f4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:45.635618 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-43d2d667-8bd4-4f19-86b5-926e8f8837f4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd25dfa539c94951a59574fd9d2591bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac44f6fd5247482cab9e535fbecdf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:45.639601 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-43d2d667-8bd4-4f19-86b5-926e8f8837f4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738" status: 200 len: 1314 microversion: 2.1 time: 0.157100 Jul 13 21:16:45.640233 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 577/1174] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:45 2022] GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:46.656941 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c2b18762-dc2b-4d72-83cd-3c94f7666de8 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:46.657658 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-c2b18762-dc2b-4d72-83cd-3c94f7666de8 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 84801551-4737-4cc5-b7af-2199c3e8a738] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:46.660060 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:16:46.665589 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c2b18762-dc2b-4d72-83cd-3c94f7666de8 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:46.666031 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c2b18762-dc2b-4d72-83cd-3c94f7666de8 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:46.666835 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c2b18762-dc2b-4d72-83cd-3c94f7666de8 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:46.667270 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c2b18762-dc2b-4d72-83cd-3c94f7666de8 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:46.671240 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=93 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:16:46.805649 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c2b18762-dc2b-4d72-83cd-3c94f7666de8 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd25dfa539c94951a59574fd9d2591bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac44f6fd5247482cab9e535fbecdf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:46.813768 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-c2b18762-dc2b-4d72-83cd-3c94f7666de8 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738" status: 200 len: 1314 microversion: 2.1 time: 0.160986 Jul 13 21:16:46.814335 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 598/1175] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:46 2022] GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:47.830428 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-846ef594-eebd-4b3d-a3df-16695ce32563 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:47.830983 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-846ef594-eebd-4b3d-a3df-16695ce32563 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 84801551-4737-4cc5-b7af-2199c3e8a738] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:47.837718 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-846ef594-eebd-4b3d-a3df-16695ce32563 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:47.838164 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-846ef594-eebd-4b3d-a3df-16695ce32563 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:47.838975 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-846ef594-eebd-4b3d-a3df-16695ce32563 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:47.839417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-846ef594-eebd-4b3d-a3df-16695ce32563 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:47.966488 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-846ef594-eebd-4b3d-a3df-16695ce32563 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd25dfa539c94951a59574fd9d2591bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac44f6fd5247482cab9e535fbecdf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:47.973833 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-846ef594-eebd-4b3d-a3df-16695ce32563 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738" status: 200 len: 1499 microversion: 2.1 time: 0.147554 Jul 13 21:16:47.974418 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 578/1176] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:47 2022] GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738 => generated 1499 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:48.693938 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-92cd6816-3a5f-4d07-a7af-e2559816bf7d tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:48.694443 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-92cd6816-3a5f-4d07-a7af-e2559816bf7d tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 84801551-4737-4cc5-b7af-2199c3e8a738] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:48.701364 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-92cd6816-3a5f-4d07-a7af-e2559816bf7d tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:48.701808 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-92cd6816-3a5f-4d07-a7af-e2559816bf7d tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:48.702681 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-92cd6816-3a5f-4d07-a7af-e2559816bf7d tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:48.703271 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-92cd6816-3a5f-4d07-a7af-e2559816bf7d tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:48.729402 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-92cd6816-3a5f-4d07-a7af-e2559816bf7d tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 84801551-4737-4cc5-b7af-2199c3e8a738] Going to try to terminate instance {{(pid=118445) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 21:16:48.800901 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-92cd6816-3a5f-4d07-a7af-e2559816bf7d tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "DELETE /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738" status: 204 len: 0 microversion: 2.1 time: 0.110355 Jul 13 21:16:48.801548 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 599/1177] 10.222.0.39 () {58 vars in 1238 bytes} [Wed Jul 13 21:16:48 2022] DELETE /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 21:16:48.810729 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-4f5f580c-8024-4e82-b065-a55f48f3737d tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:48.811331 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-4f5f580c-8024-4e82-b065-a55f48f3737d tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 84801551-4737-4cc5-b7af-2199c3e8a738] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:48.813306 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:16:48.824948 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4f5f580c-8024-4e82-b065-a55f48f3737d tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:48.825395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4f5f580c-8024-4e82-b065-a55f48f3737d tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:48.826189 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4f5f580c-8024-4e82-b065-a55f48f3737d tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:48.826642 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4f5f580c-8024-4e82-b065-a55f48f3737d tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:48.956098 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-4f5f580c-8024-4e82-b065-a55f48f3737d tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd25dfa539c94951a59574fd9d2591bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac44f6fd5247482cab9e535fbecdf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:48.963505 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-4f5f580c-8024-4e82-b065-a55f48f3737d tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738" status: 200 len: 1505 microversion: 2.1 time: 0.157473 Jul 13 21:16:48.964068 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 579/1178] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:48 2022] GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:49.982139 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-583d17e3-3648-4d89-a553-1a798e7a1cdf tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:49.982851 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-583d17e3-3648-4d89-a553-1a798e7a1cdf tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 84801551-4737-4cc5-b7af-2199c3e8a738] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:49.989249 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-583d17e3-3648-4d89-a553-1a798e7a1cdf tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:49.989687 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-583d17e3-3648-4d89-a553-1a798e7a1cdf tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:49.990437 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-583d17e3-3648-4d89-a553-1a798e7a1cdf tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:49.990890 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-583d17e3-3648-4d89-a553-1a798e7a1cdf tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:50.123131 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-583d17e3-3648-4d89-a553-1a798e7a1cdf tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd25dfa539c94951a59574fd9d2591bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac44f6fd5247482cab9e535fbecdf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:50.130406 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-583d17e3-3648-4d89-a553-1a798e7a1cdf tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738" status: 200 len: 1505 microversion: 2.1 time: 0.153030 Jul 13 21:16:50.130994 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 600/1179] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:49 2022] GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:51.148500 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ecd1b183-8d46-48e5-83b8-e092d79ea3f3 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:51.149109 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-ecd1b183-8d46-48e5-83b8-e092d79ea3f3 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 84801551-4737-4cc5-b7af-2199c3e8a738] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:51.156266 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ecd1b183-8d46-48e5-83b8-e092d79ea3f3 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:51.156713 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ecd1b183-8d46-48e5-83b8-e092d79ea3f3 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:51.157969 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ecd1b183-8d46-48e5-83b8-e092d79ea3f3 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:51.158671 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ecd1b183-8d46-48e5-83b8-e092d79ea3f3 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:51.237277 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-97bb788b-573a-4556-b03a-a855a7208ded req-2ebc61e4-fc9f-4362-9d2a-4b915be3dcb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84801551-4737-4cc5-b7af-2199c3e8a738", "name": "network-vif-deleted", "tag": "40c6a509-485d-4651-984f-2d19a0b17157"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:16:51.247124 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-97bb788b-573a-4556-b03a-a855a7208ded req-2ebc61e4-fc9f-4362-9d2a-4b915be3dcb4 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:51.247565 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-97bb788b-573a-4556-b03a-a855a7208ded req-2ebc61e4-fc9f-4362-9d2a-4b915be3dcb4 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:51.254572 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ecd1b183-8d46-48e5-83b8-e092d79ea3f3 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd25dfa539c94951a59574fd9d2591bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac44f6fd5247482cab9e535fbecdf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:51.260098 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-97bb788b-573a-4556-b03a-a855a7208ded req-2ebc61e4-fc9f-4362-9d2a-4b915be3dcb4 service nova] Creating event network-vif-deleted:40c6a509-485d-4651-984f-2d19a0b17157 for instance 84801551-4737-4cc5-b7af-2199c3e8a738 on hv-cinder-79987 Jul 13 21:16:51.262983 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ecd1b183-8d46-48e5-83b8-e092d79ea3f3 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738" status: 200 len: 1463 microversion: 2.1 time: 0.118130 Jul 13 21:16:51.263903 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 580/1180] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:51 2022] GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738 => generated 1463 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:51.268382 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-97bb788b-573a-4556-b03a-a855a7208ded req-2ebc61e4-fc9f-4362-9d2a-4b915be3dcb4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034710 Jul 13 21:16:51.269517 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 601/1181] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:16:52.280612 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-13195dda-8fb7-43fb-8f89-0b1e437d8049 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:52.281213 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-13195dda-8fb7-43fb-8f89-0b1e437d8049 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 84801551-4737-4cc5-b7af-2199c3e8a738] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:52.287217 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-13195dda-8fb7-43fb-8f89-0b1e437d8049 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:52.287664 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-13195dda-8fb7-43fb-8f89-0b1e437d8049 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:52.288416 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-13195dda-8fb7-43fb-8f89-0b1e437d8049 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:52.288849 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-13195dda-8fb7-43fb-8f89-0b1e437d8049 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:52.302321 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.wsgi [None req-13195dda-8fb7-43fb-8f89-0b1e437d8049 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] HTTP exception thrown: Instance 84801551-4737-4cc5-b7af-2199c3e8a738 could not be found. Jul 13 21:16:52.303846 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-13195dda-8fb7-43fb-8f89-0b1e437d8049 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Request method failure captured: Jul 13 21:16:52.303846 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: request: GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738 HTTP/1.1 Jul 13 21:16:52.303846 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept: application/json Jul 13 21:16:52.303846 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept-Encoding: identity Jul 13 21:16:52.303846 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Connection: close Jul 13 21:16:52.303846 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Length: 0 Jul 13 21:16:52.303846 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Type: application/json Jul 13 21:16:52.303846 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Host: 10.222.0.39 Jul 13 21:16:52.303846 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Openstack-System-Scope: None Jul 13 21:16:52.303846 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: User-Agent: python-urllib3/1.26.9 Jul 13 21:16:52.303846 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Auth-Token: gAAAAABizzYsKQkvZs3RF9Y1fQVLdxilMpqACHj99whPZEOS8pi7MS4o2Ama6HfwKSFQ6PBn-PX2C6KIAmARal-EaGw6CM7tbeo5TljJszpDvzCJ8a7bq5P3EDoLAZVQPearyhO9GBB2c1ikkZc5dO7ZusEN8aNUrLK8SOtqA70J4eLoIgu_vp4 Jul 13 21:16:52.303846 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Id: None Jul 13 21:16:52.303846 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Name: None Jul 13 21:16:52.303846 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Identity-Status: Confirmed Jul 13 21:16:52.303846 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Is-Admin-Project: True Jul 13 21:16:52.303846 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Id: default Jul 13 21:16:52.303846 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Name: Default Jul 13 21:16:52.303846 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Id: ac44f6fd5247482cab9e535fbecdf2b8 Jul 13 21:16:52.303846 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Name: tempest-VolumesActionsTest-26792634 Jul 13 21:16:52.303846 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Role: member,reader Jul 13 21:16:52.303846 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Roles: member,reader Jul 13 21:16:52.305507 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac44f6fd5247482cab9e535fbecdf2b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ac44f6fd5247482cab9e535fbecdf2b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ac44f6fd5247482cab9e535fbecdf2b8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac44f6fd5247482cab9e535fbecdf2b8"}]}] Jul 13 21:16:52.305507 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant: tempest-VolumesActionsTest-26792634 Jul 13 21:16:52.305507 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Id: ac44f6fd5247482cab9e535fbecdf2b8 Jul 13 21:16:52.305507 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Name: tempest-VolumesActionsTest-26792634 Jul 13 21:16:52.305507 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User: tempest-VolumesActionsTest-26792634-project Jul 13 21:16:52.305507 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Id: default Jul 13 21:16:52.305507 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Name: Default Jul 13 21:16:52.305507 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Id: dd25dfa539c94951a59574fd9d2591bb Jul 13 21:16:52.305507 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Name: tempest-VolumesActionsTest-26792634-project Jul 13 21:16:52.305507 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: method: > Jul 13 21:16:52.305507 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: exception: Instance 84801551-4737-4cc5-b7af-2199c3e8a738 could not be found. Jul 13 21:16:52.305507 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: action_args: {'id': '84801551-4737-4cc5-b7af-2199c3e8a738'} Jul 13 21:16:52.306638 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:16:52.306638 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:16:52.306638 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:16:52.306638 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:16:52.306638 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:16:52.306638 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:16:52.306638 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:16:52.306638 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:16:52.306638 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:16:52.306638 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:16:52.306638 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84801551-4737-4cc5-b7af-2199c3e8a738 could not be found. Jul 13 21:16:52.306638 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:16:52.306638 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:16:52.306638 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:16:52.306638 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:16:52.306638 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:16:52.306638 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:16:52.306638 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:16:52.306638 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:16:52.306638 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:16:52.308783 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:16:52.308783 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 21:16:52.308783 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 21:16:52.308783 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:16:52.308783 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:16:52.308783 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:16:52.308783 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:16:52.308783 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84801551-4737-4cc5-b7af-2199c3e8a738 could not be found. Jul 13 21:16:52.308783 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:16:52.308783 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:16:52.308783 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:16:52.308783 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:16:52.308783 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:16:52.308783 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:16:52.308783 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:16:52.308783 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:16:52.308783 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84801551-4737-4cc5-b7af-2199c3e8a738 could not be found. Jul 13 21:16:52.308783 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:16:52.310165 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-13195dda-8fb7-43fb-8f89-0b1e437d8049 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Returning 404 to user: Instance 84801551-4737-4cc5-b7af-2199c3e8a738 could not be found. {{(pid=118444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:16:52.310165 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-13195dda-8fb7-43fb-8f89-0b1e437d8049 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738" status: 404 len: 111 microversion: 2.1 time: 0.029117 Jul 13 21:16:52.310165 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 581/1182] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:52 2022] GET /compute/v2.1/servers/84801551-4737-4cc5-b7af-2199c3e8a738 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:16:52.406543 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-674cdfe2-5a8b-41c0-9089-3b34dd945efc tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2143460857", "imageRef": "5a995c88-d784-4a51-a6b9-25aa9dfe607c", "flavorRef": "452", "networks": [{"uuid": "5068c946-beb1-431b-9723-d5006ec91fba"}]}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:16:52.456231 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.network.neutron [None req-674cdfe2-5a8b-41c0-9089-3b34dd945efc tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] validate_networks() for [('5068c946-beb1-431b-9723-d5006ec91fba', None, None, None, None, None)] {{(pid=118445) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 21:16:52.901125 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-674cdfe2-5a8b-41c0-9089-3b34dd945efc tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Flavor limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 21:16:52.901557 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-674cdfe2-5a8b-41c0-9089-3b34dd945efc tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Image limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 21:16:52.902033 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-674cdfe2-5a8b-41c0-9089-3b34dd945efc tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Flavor pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 21:16:52.902444 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-674cdfe2-5a8b-41c0-9089-3b34dd945efc tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Image pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 21:16:52.902923 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-674cdfe2-5a8b-41c0-9089-3b34dd945efc tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 21:16:52.911688 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-674cdfe2-5a8b-41c0-9089-3b34dd945efc tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:52.912168 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-674cdfe2-5a8b-41c0-9089-3b34dd945efc tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:52.912968 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-674cdfe2-5a8b-41c0-9089-3b34dd945efc tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:52.913417 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-674cdfe2-5a8b-41c0-9089-3b34dd945efc tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:52.929744 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-674cdfe2-5a8b-41c0-9089-3b34dd945efc tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Getting quotas for project ac44f6fd5247482cab9e535fbecdf2b8. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:16:52.934160 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-674cdfe2-5a8b-41c0-9089-3b34dd945efc tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Getting quotas for user dd25dfa539c94951a59574fd9d2591bb and project ac44f6fd5247482cab9e535fbecdf2b8. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:16:52.944827 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-674cdfe2-5a8b-41c0-9089-3b34dd945efc tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Going to run 1 instances... {{(pid=118445) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 21:16:52.947204 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-674cdfe2-5a8b-41c0-9089-3b34dd945efc tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 8e554514-9a71-40da-81ba-8d7ba94a9240] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995c88-d784-4a51-a6b9-25aa9dfe607c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118445) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 21:16:52.991899 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-674cdfe2-5a8b-41c0-9089-3b34dd945efc tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590000 Jul 13 21:16:52.992710 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 602/1183] 10.222.0.39 () {60 vars in 1146 bytes} [Wed Jul 13 21:16:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 21:16:53.003265 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-f5af3541-d150-4345-bbe2-e810c91fe3f7 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:53.003867 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-f5af3541-d150-4345-bbe2-e810c91fe3f7 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 8e554514-9a71-40da-81ba-8d7ba94a9240] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:53.059378 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f5af3541-d150-4345-bbe2-e810c91fe3f7 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd25dfa539c94951a59574fd9d2591bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac44f6fd5247482cab9e535fbecdf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:53.066854 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-f5af3541-d150-4345-bbe2-e810c91fe3f7 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240" status: 200 len: 1214 microversion: 2.1 time: 0.067203 Jul 13 21:16:53.075057 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 582/1184] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:52 2022] GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:54.085251 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-b73b52b2-a482-4072-b5df-e70e5312deb0 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:54.086056 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-b73b52b2-a482-4072-b5df-e70e5312deb0 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 8e554514-9a71-40da-81ba-8d7ba94a9240] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:54.095165 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b73b52b2-a482-4072-b5df-e70e5312deb0 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:54.095612 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b73b52b2-a482-4072-b5df-e70e5312deb0 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:54.096378 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b73b52b2-a482-4072-b5df-e70e5312deb0 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:54.096809 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b73b52b2-a482-4072-b5df-e70e5312deb0 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:54.162746 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b73b52b2-a482-4072-b5df-e70e5312deb0 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd25dfa539c94951a59574fd9d2591bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac44f6fd5247482cab9e535fbecdf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:54.170117 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-b73b52b2-a482-4072-b5df-e70e5312deb0 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240" status: 200 len: 1272 microversion: 2.1 time: 0.089583 Jul 13 21:16:54.170688 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 603/1185] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:54 2022] GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240 => generated 1272 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:55.187283 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-f78955e9-a1a4-4e08-9b41-d4034604f7b8 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:55.187951 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-f78955e9-a1a4-4e08-9b41-d4034604f7b8 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 8e554514-9a71-40da-81ba-8d7ba94a9240] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:55.197907 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f78955e9-a1a4-4e08-9b41-d4034604f7b8 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:55.198391 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f78955e9-a1a4-4e08-9b41-d4034604f7b8 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:55.199201 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f78955e9-a1a4-4e08-9b41-d4034604f7b8 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:55.199789 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f78955e9-a1a4-4e08-9b41-d4034604f7b8 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:55.234471 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-b621c4ee-7ce6-4e96-9eb0-8411a4c8497c req-324c7ecc-3399-4361-9dd1-a874c3005997 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e554514-9a71-40da-81ba-8d7ba94a9240", "tag": "8681cf8e-f7b0-48ad-9a95-78abbf84fec9"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:16:55.242754 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-b621c4ee-7ce6-4e96-9eb0-8411a4c8497c req-324c7ecc-3399-4361-9dd1-a874c3005997 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:55.243187 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-b621c4ee-7ce6-4e96-9eb0-8411a4c8497c req-324c7ecc-3399-4361-9dd1-a874c3005997 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:55.253960 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-b621c4ee-7ce6-4e96-9eb0-8411a4c8497c req-324c7ecc-3399-4361-9dd1-a874c3005997 service nova] Creating event network-changed:8681cf8e-f7b0-48ad-9a95-78abbf84fec9 for instance 8e554514-9a71-40da-81ba-8d7ba94a9240 on hv-cinder-79987 Jul 13 21:16:55.258527 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-b621c4ee-7ce6-4e96-9eb0-8411a4c8497c req-324c7ecc-3399-4361-9dd1-a874c3005997 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028212 Jul 13 21:16:55.259148 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 604/1186] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:16:55.351348 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f78955e9-a1a4-4e08-9b41-d4034604f7b8 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd25dfa539c94951a59574fd9d2591bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac44f6fd5247482cab9e535fbecdf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:55.366388 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-f78955e9-a1a4-4e08-9b41-d4034604f7b8 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240" status: 200 len: 1314 microversion: 2.1 time: 0.182922 Jul 13 21:16:55.366984 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 583/1187] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:55 2022] GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:56.383376 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-939fa071-3b57-413b-be33-ed99c1c9b494 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:56.384076 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-939fa071-3b57-413b-be33-ed99c1c9b494 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 8e554514-9a71-40da-81ba-8d7ba94a9240] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:56.390458 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-939fa071-3b57-413b-be33-ed99c1c9b494 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:56.390939 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-939fa071-3b57-413b-be33-ed99c1c9b494 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:56.391698 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-939fa071-3b57-413b-be33-ed99c1c9b494 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:56.392130 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-939fa071-3b57-413b-be33-ed99c1c9b494 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:56.519115 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-939fa071-3b57-413b-be33-ed99c1c9b494 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd25dfa539c94951a59574fd9d2591bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac44f6fd5247482cab9e535fbecdf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:56.526415 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-939fa071-3b57-413b-be33-ed99c1c9b494 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240" status: 200 len: 1314 microversion: 2.1 time: 0.147777 Jul 13 21:16:56.527008 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 605/1188] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:56 2022] GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:57.543555 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-5e0e8c7c-bea6-4c74-8b69-36309fc586fd tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:57.544187 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-5e0e8c7c-bea6-4c74-8b69-36309fc586fd tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 8e554514-9a71-40da-81ba-8d7ba94a9240] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:57.550766 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5e0e8c7c-bea6-4c74-8b69-36309fc586fd tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:57.551214 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5e0e8c7c-bea6-4c74-8b69-36309fc586fd tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:57.552212 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5e0e8c7c-bea6-4c74-8b69-36309fc586fd tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:57.552597 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5e0e8c7c-bea6-4c74-8b69-36309fc586fd tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:57.687737 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-5e0e8c7c-bea6-4c74-8b69-36309fc586fd tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd25dfa539c94951a59574fd9d2591bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac44f6fd5247482cab9e535fbecdf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:57.695249 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-5e0e8c7c-bea6-4c74-8b69-36309fc586fd tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240" status: 200 len: 1314 microversion: 2.1 time: 0.155475 Jul 13 21:16:57.695819 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 584/1189] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:57 2022] GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:58.712641 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-e537b1ba-f2ff-45b1-9c00-c7b812b2ad1b tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:58.713940 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-e537b1ba-f2ff-45b1-9c00-c7b812b2ad1b tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 8e554514-9a71-40da-81ba-8d7ba94a9240] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:58.720104 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e537b1ba-f2ff-45b1-9c00-c7b812b2ad1b tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:58.720550 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e537b1ba-f2ff-45b1-9c00-c7b812b2ad1b tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:58.721310 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e537b1ba-f2ff-45b1-9c00-c7b812b2ad1b tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:58.721744 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e537b1ba-f2ff-45b1-9c00-c7b812b2ad1b tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:58.851460 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-e537b1ba-f2ff-45b1-9c00-c7b812b2ad1b tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd25dfa539c94951a59574fd9d2591bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac44f6fd5247482cab9e535fbecdf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:16:58.859335 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-e537b1ba-f2ff-45b1-9c00-c7b812b2ad1b tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240" status: 200 len: 1314 microversion: 2.1 time: 0.150897 Jul 13 21:16:58.859897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 606/1190] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:58 2022] GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:16:59.876263 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-1fca2627-6169-4fe2-8377-00b2a75b3460 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:16:59.876864 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-1fca2627-6169-4fe2-8377-00b2a75b3460 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 8e554514-9a71-40da-81ba-8d7ba94a9240] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:16:59.883314 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1fca2627-6169-4fe2-8377-00b2a75b3460 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:59.883757 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1fca2627-6169-4fe2-8377-00b2a75b3460 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:16:59.884511 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1fca2627-6169-4fe2-8377-00b2a75b3460 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:16:59.885193 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1fca2627-6169-4fe2-8377-00b2a75b3460 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:00.010719 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-1fca2627-6169-4fe2-8377-00b2a75b3460 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd25dfa539c94951a59574fd9d2591bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac44f6fd5247482cab9e535fbecdf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:17:00.018004 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-1fca2627-6169-4fe2-8377-00b2a75b3460 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240" status: 200 len: 1314 microversion: 2.1 time: 0.145537 Jul 13 21:17:00.018568 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 585/1191] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:16:59 2022] GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:17:01.034656 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-29b7c5b1-4c09-42fd-aefc-0d5627054ad3 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:17:01.035257 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-29b7c5b1-4c09-42fd-aefc-0d5627054ad3 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 8e554514-9a71-40da-81ba-8d7ba94a9240] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:17:01.041649 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-29b7c5b1-4c09-42fd-aefc-0d5627054ad3 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:01.042049 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-29b7c5b1-4c09-42fd-aefc-0d5627054ad3 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:01.042832 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-29b7c5b1-4c09-42fd-aefc-0d5627054ad3 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:01.043257 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-29b7c5b1-4c09-42fd-aefc-0d5627054ad3 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:01.174033 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-29b7c5b1-4c09-42fd-aefc-0d5627054ad3 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd25dfa539c94951a59574fd9d2591bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac44f6fd5247482cab9e535fbecdf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:17:01.181444 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-29b7c5b1-4c09-42fd-aefc-0d5627054ad3 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240" status: 200 len: 1314 microversion: 2.1 time: 0.150630 Jul 13 21:17:01.182007 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 607/1192] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:17:01 2022] GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:17:02.197817 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-6c938af1-a063-4d94-aa1a-221a1c7920b4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:17:02.198434 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-6c938af1-a063-4d94-aa1a-221a1c7920b4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 8e554514-9a71-40da-81ba-8d7ba94a9240] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:17:02.205473 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6c938af1-a063-4d94-aa1a-221a1c7920b4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:02.205990 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6c938af1-a063-4d94-aa1a-221a1c7920b4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:02.206816 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6c938af1-a063-4d94-aa1a-221a1c7920b4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:02.207257 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-6c938af1-a063-4d94-aa1a-221a1c7920b4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:02.336210 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-6c938af1-a063-4d94-aa1a-221a1c7920b4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd25dfa539c94951a59574fd9d2591bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac44f6fd5247482cab9e535fbecdf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:17:02.344140 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-6c938af1-a063-4d94-aa1a-221a1c7920b4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240" status: 200 len: 1314 microversion: 2.1 time: 0.150152 Jul 13 21:17:02.344734 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 586/1193] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:17:02 2022] GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:17:02.861346 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-f0b47577-d4ce-4230-bd8c-b9ae13ec3f7b req-89899205-9e5f-4753-819f-c86d788afed7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e554514-9a71-40da-81ba-8d7ba94a9240", "name": "network-vif-plugged", "status": "completed", "tag": "8681cf8e-f7b0-48ad-9a95-78abbf84fec9"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:17:02.889941 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-f0b47577-d4ce-4230-bd8c-b9ae13ec3f7b req-89899205-9e5f-4753-819f-c86d788afed7 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:02.890384 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-f0b47577-d4ce-4230-bd8c-b9ae13ec3f7b req-89899205-9e5f-4753-819f-c86d788afed7 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:02.901641 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-f0b47577-d4ce-4230-bd8c-b9ae13ec3f7b req-89899205-9e5f-4753-819f-c86d788afed7 service nova] Creating event network-vif-plugged:8681cf8e-f7b0-48ad-9a95-78abbf84fec9 for instance 8e554514-9a71-40da-81ba-8d7ba94a9240 on hv-cinder-79987 Jul 13 21:17:02.907924 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-f0b47577-d4ce-4230-bd8c-b9ae13ec3f7b req-89899205-9e5f-4753-819f-c86d788afed7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052851 Jul 13 21:17:02.908939 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 608/1194] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:17:03.361624 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ccb9102b-d3b3-42cc-b48d-035ddacdfe03 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:17:03.362390 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-ccb9102b-d3b3-42cc-b48d-035ddacdfe03 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 8e554514-9a71-40da-81ba-8d7ba94a9240] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:17:03.364226 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell0:SELECT=2 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:17:03.370352 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ccb9102b-d3b3-42cc-b48d-035ddacdfe03 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:03.372805 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ccb9102b-d3b3-42cc-b48d-035ddacdfe03 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:03.373581 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ccb9102b-d3b3-42cc-b48d-035ddacdfe03 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:03.374014 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ccb9102b-d3b3-42cc-b48d-035ddacdfe03 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:03.514448 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ccb9102b-d3b3-42cc-b48d-035ddacdfe03 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd25dfa539c94951a59574fd9d2591bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac44f6fd5247482cab9e535fbecdf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:17:03.523799 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ccb9102b-d3b3-42cc-b48d-035ddacdfe03 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240" status: 200 len: 1314 microversion: 2.1 time: 0.166187 Jul 13 21:17:03.524540 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 587/1195] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:17:03 2022] GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:17:04.540894 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-34bd0cef-17fb-40d0-ba37-7f0f50f99d07 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:17:04.541493 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-34bd0cef-17fb-40d0-ba37-7f0f50f99d07 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 8e554514-9a71-40da-81ba-8d7ba94a9240] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:17:04.544745 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=2 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:17:04.545517 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=6 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:17:04.549755 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-34bd0cef-17fb-40d0-ba37-7f0f50f99d07 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:04.550218 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-34bd0cef-17fb-40d0-ba37-7f0f50f99d07 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:04.550988 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-34bd0cef-17fb-40d0-ba37-7f0f50f99d07 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:04.551448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-34bd0cef-17fb-40d0-ba37-7f0f50f99d07 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:04.759206 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-34bd0cef-17fb-40d0-ba37-7f0f50f99d07 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd25dfa539c94951a59574fd9d2591bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac44f6fd5247482cab9e535fbecdf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:17:04.767955 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-34bd0cef-17fb-40d0-ba37-7f0f50f99d07 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240" status: 200 len: 1498 microversion: 2.1 time: 0.231375 Jul 13 21:17:04.768534 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 609/1196] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:17:04 2022] GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240 => generated 1498 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:17:05.321296 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-5de905dd-7ba7-4393-9d76-edd25f12160c tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:17:05.322451 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-5de905dd-7ba7-4393-9d76-edd25f12160c tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 8e554514-9a71-40da-81ba-8d7ba94a9240] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:17:05.331265 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5de905dd-7ba7-4393-9d76-edd25f12160c tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:05.332029 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5de905dd-7ba7-4393-9d76-edd25f12160c tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:05.333053 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5de905dd-7ba7-4393-9d76-edd25f12160c tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:05.333708 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5de905dd-7ba7-4393-9d76-edd25f12160c tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:05.372351 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-5de905dd-7ba7-4393-9d76-edd25f12160c tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 8e554514-9a71-40da-81ba-8d7ba94a9240] Going to try to terminate instance {{(pid=118444) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 21:17:05.484852 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-5de905dd-7ba7-4393-9d76-edd25f12160c tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240" status: 204 len: 0 microversion: 2.1 time: 0.167419 Jul 13 21:17:05.485354 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 588/1197] 10.222.0.39 () {58 vars in 1238 bytes} [Wed Jul 13 21:17:05 2022] DELETE /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 21:17:05.493419 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-1f0db361-7097-4596-b1af-935fcfab40c3 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:17:05.494031 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-1f0db361-7097-4596-b1af-935fcfab40c3 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 8e554514-9a71-40da-81ba-8d7ba94a9240] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:17:05.500063 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1f0db361-7097-4596-b1af-935fcfab40c3 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:05.500513 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1f0db361-7097-4596-b1af-935fcfab40c3 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:05.501284 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1f0db361-7097-4596-b1af-935fcfab40c3 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:05.501911 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1f0db361-7097-4596-b1af-935fcfab40c3 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:05.732871 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-1f0db361-7097-4596-b1af-935fcfab40c3 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd25dfa539c94951a59574fd9d2591bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac44f6fd5247482cab9e535fbecdf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:17:05.740208 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-1f0db361-7097-4596-b1af-935fcfab40c3 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240" status: 200 len: 1504 microversion: 2.1 time: 0.250578 Jul 13 21:17:05.740981 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 610/1198] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:17:05 2022] GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240 => generated 1504 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:17:06.758995 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b0e092ea-df22-4210-b12c-91ac00796193 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:17:06.760029 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b0e092ea-df22-4210-b12c-91ac00796193 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 8e554514-9a71-40da-81ba-8d7ba94a9240] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:17:06.768546 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b0e092ea-df22-4210-b12c-91ac00796193 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:06.769354 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b0e092ea-df22-4210-b12c-91ac00796193 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:06.770341 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b0e092ea-df22-4210-b12c-91ac00796193 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:06.771157 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b0e092ea-df22-4210-b12c-91ac00796193 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:06.915953 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b0e092ea-df22-4210-b12c-91ac00796193 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd25dfa539c94951a59574fd9d2591bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac44f6fd5247482cab9e535fbecdf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:17:06.924188 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b0e092ea-df22-4210-b12c-91ac00796193 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240" status: 200 len: 1504 microversion: 2.1 time: 0.169753 Jul 13 21:17:06.924771 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 589/1199] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:17:06 2022] GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240 => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:17:07.643223 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-4933fe53-d34b-43c4-8d8e-66550773c26c req-5705b684-4994-4307-8d48-30fa02b542c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e554514-9a71-40da-81ba-8d7ba94a9240", "name": "network-vif-deleted", "tag": "8681cf8e-f7b0-48ad-9a95-78abbf84fec9"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:17:07.657786 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-4933fe53-d34b-43c4-8d8e-66550773c26c req-5705b684-4994-4307-8d48-30fa02b542c6 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:07.658335 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-4933fe53-d34b-43c4-8d8e-66550773c26c req-5705b684-4994-4307-8d48-30fa02b542c6 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:07.675877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-4933fe53-d34b-43c4-8d8e-66550773c26c req-5705b684-4994-4307-8d48-30fa02b542c6 service nova] Creating event network-vif-deleted:8681cf8e-f7b0-48ad-9a95-78abbf84fec9 for instance 8e554514-9a71-40da-81ba-8d7ba94a9240 on hv-cinder-79987 Jul 13 21:17:07.681494 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-4933fe53-d34b-43c4-8d8e-66550773c26c req-5705b684-4994-4307-8d48-30fa02b542c6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042120 Jul 13 21:17:07.682249 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 611/1200] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:17:07.948109 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0ff95e09-64a8-4d47-b61d-bcfc1cbbb1a4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:17:07.950004 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-0ff95e09-64a8-4d47-b61d-bcfc1cbbb1a4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 8e554514-9a71-40da-81ba-8d7ba94a9240] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:17:07.959822 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0ff95e09-64a8-4d47-b61d-bcfc1cbbb1a4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:07.960720 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0ff95e09-64a8-4d47-b61d-bcfc1cbbb1a4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:07.962299 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0ff95e09-64a8-4d47-b61d-bcfc1cbbb1a4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:07.963361 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0ff95e09-64a8-4d47-b61d-bcfc1cbbb1a4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:08.003780 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0ff95e09-64a8-4d47-b61d-bcfc1cbbb1a4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:08.004880 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0ff95e09-64a8-4d47-b61d-bcfc1cbbb1a4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:08.005485 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.objects.instance [None req-0ff95e09-64a8-4d47-b61d-bcfc1cbbb1a4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lazy-loading 'fault' on Instance uuid 8e554514-9a71-40da-81ba-8d7ba94a9240 {{(pid=118444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:17:08.053760 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-0ff95e09-64a8-4d47-b61d-bcfc1cbbb1a4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd25dfa539c94951a59574fd9d2591bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac44f6fd5247482cab9e535fbecdf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:17:08.073823 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-0ff95e09-64a8-4d47-b61d-bcfc1cbbb1a4 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240" status: 200 len: 1304 microversion: 2.1 time: 0.134715 Jul 13 21:17:08.075283 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 590/1201] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:17:07 2022] GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240 => generated 1304 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:17:09.094257 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-5118c05e-f1e0-43b4-b0be-ea0913ce8781 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:17:09.094802 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-5118c05e-f1e0-43b4-b0be-ea0913ce8781 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] [instance: 8e554514-9a71-40da-81ba-8d7ba94a9240] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:17:09.101265 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5118c05e-f1e0-43b4-b0be-ea0913ce8781 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:09.101760 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5118c05e-f1e0-43b4-b0be-ea0913ce8781 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:09.102560 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5118c05e-f1e0-43b4-b0be-ea0913ce8781 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:09.103033 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5118c05e-f1e0-43b4-b0be-ea0913ce8781 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:09.120593 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.wsgi [None req-5118c05e-f1e0-43b4-b0be-ea0913ce8781 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] HTTP exception thrown: Instance 8e554514-9a71-40da-81ba-8d7ba94a9240 could not be found. Jul 13 21:17:09.124335 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-5118c05e-f1e0-43b4-b0be-ea0913ce8781 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Request method failure captured: Jul 13 21:17:09.124335 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: request: GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240 HTTP/1.1 Jul 13 21:17:09.124335 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept: application/json Jul 13 21:17:09.124335 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept-Encoding: identity Jul 13 21:17:09.124335 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Connection: close Jul 13 21:17:09.124335 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Length: 0 Jul 13 21:17:09.124335 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Type: application/json Jul 13 21:17:09.124335 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Host: 10.222.0.39 Jul 13 21:17:09.124335 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Openstack-System-Scope: None Jul 13 21:17:09.124335 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: User-Agent: python-urllib3/1.26.9 Jul 13 21:17:09.124335 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Auth-Token: gAAAAABizzYsKQkvZs3RF9Y1fQVLdxilMpqACHj99whPZEOS8pi7MS4o2Ama6HfwKSFQ6PBn-PX2C6KIAmARal-EaGw6CM7tbeo5TljJszpDvzCJ8a7bq5P3EDoLAZVQPearyhO9GBB2c1ikkZc5dO7ZusEN8aNUrLK8SOtqA70J4eLoIgu_vp4 Jul 13 21:17:09.124335 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Id: None Jul 13 21:17:09.124335 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Name: None Jul 13 21:17:09.124335 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Identity-Status: Confirmed Jul 13 21:17:09.124335 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Is-Admin-Project: True Jul 13 21:17:09.124335 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Id: default Jul 13 21:17:09.124335 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Name: Default Jul 13 21:17:09.124335 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Id: ac44f6fd5247482cab9e535fbecdf2b8 Jul 13 21:17:09.124335 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Name: tempest-VolumesActionsTest-26792634 Jul 13 21:17:09.124335 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Role: member,reader Jul 13 21:17:09.124335 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Roles: member,reader Jul 13 21:17:09.125774 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac44f6fd5247482cab9e535fbecdf2b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ac44f6fd5247482cab9e535fbecdf2b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ac44f6fd5247482cab9e535fbecdf2b8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac44f6fd5247482cab9e535fbecdf2b8"}]}] Jul 13 21:17:09.125774 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant: tempest-VolumesActionsTest-26792634 Jul 13 21:17:09.125774 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Id: ac44f6fd5247482cab9e535fbecdf2b8 Jul 13 21:17:09.125774 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Name: tempest-VolumesActionsTest-26792634 Jul 13 21:17:09.125774 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User: tempest-VolumesActionsTest-26792634-project Jul 13 21:17:09.125774 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Id: default Jul 13 21:17:09.125774 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Name: Default Jul 13 21:17:09.125774 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Id: dd25dfa539c94951a59574fd9d2591bb Jul 13 21:17:09.125774 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Name: tempest-VolumesActionsTest-26792634-project Jul 13 21:17:09.125774 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: method: > Jul 13 21:17:09.125774 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: exception: Instance 8e554514-9a71-40da-81ba-8d7ba94a9240 could not be found. Jul 13 21:17:09.125774 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: action_args: {'id': '8e554514-9a71-40da-81ba-8d7ba94a9240'} Jul 13 21:17:09.126927 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:17:09.126927 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:17:09.126927 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:17:09.126927 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:17:09.126927 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:17:09.126927 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:17:09.126927 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:17:09.126927 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:17:09.126927 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:17:09.126927 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:17:09.126927 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e554514-9a71-40da-81ba-8d7ba94a9240 could not be found. Jul 13 21:17:09.126927 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:17:09.126927 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:17:09.126927 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:17:09.126927 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:17:09.126927 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:17:09.126927 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:17:09.126927 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:17:09.126927 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:17:09.126927 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:17:09.128686 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:17:09.128686 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 21:17:09.128686 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 21:17:09.128686 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:17:09.128686 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:17:09.128686 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:17:09.128686 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:17:09.128686 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e554514-9a71-40da-81ba-8d7ba94a9240 could not be found. Jul 13 21:17:09.128686 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:17:09.128686 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:17:09.128686 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:17:09.128686 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:17:09.128686 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:17:09.128686 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:17:09.128686 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:17:09.128686 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:17:09.128686 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e554514-9a71-40da-81ba-8d7ba94a9240 could not be found. Jul 13 21:17:09.128686 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:17:09.130014 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-5118c05e-f1e0-43b4-b0be-ea0913ce8781 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] Returning 404 to user: Instance 8e554514-9a71-40da-81ba-8d7ba94a9240 could not be found. {{(pid=118445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:17:09.130014 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-5118c05e-f1e0-43b4-b0be-ea0913ce8781 tempest-VolumesActionsTest-26792634 tempest-VolumesActionsTest-26792634-project] 10.222.0.39 "GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240" status: 404 len: 111 microversion: 2.1 time: 0.036656 Jul 13 21:17:09.130014 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 612/1202] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:17:09 2022] GET /compute/v2.1/servers/8e554514-9a71-40da-81ba-8d7ba94a9240 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:17:13.261384 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-d39ff3b9-d162-418a-bcfb-e2d4c943266b tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Action: 'create', calling method: .version_select at 0x7f96e88ddb80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1311636940", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3rh0ylIdvS7f2feovdmJ7L5y+iPDOCXVkaJDv2VQn8p9naMd8O3nAv+UfA9Ouqd7tuE3BrZG0ZFocT3Z0NP0eseHlUWaS7J0FvjSs3gS4YELeJUqkgWsSdTBZB2hXY9g=="}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:17:13.289787 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.quota [None req-d39ff3b9-d162-418a-bcfb-e2d4c943266b tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Getting quotas for project 3ed08895dc72486783da247550696d4c. Resources: {'key_pairs'} {{(pid=118444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:17:13.300594 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.quota [None req-d39ff3b9-d162-418a-bcfb-e2d4c943266b tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Getting quotas for user 72ad69b2fab34a6180d7353c1aa730d3 and project 3ed08895dc72486783da247550696d4c. Resources: {'key_pairs'} {{(pid=118444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:17:13.328641 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-d39ff3b9-d162-418a-bcfb-e2d4c943266b tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.294215 Jul 13 21:17:13.329609 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 591/1203] 10.222.0.39 () {60 vars in 1158 bytes} [Wed Jul 13 21:17:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:17:40.453694 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-e44dca60-03d5-428d-9a58-9f0779f35a9f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-190772954", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1311636940", "security_groups": [{"name": "tempest-secgroup-smoke-30976695"}], "block_device_mapping_v2": [{"uuid": "94190149-fb43-4c34-af73-2de6fc43e5dd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5028f2a2-a7e7-4b29-9df9-5d7a5fdea67a"}]}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:17:40.462665 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:17:40.466828 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:17:40.619101 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.network.neutron [None req-e44dca60-03d5-428d-9a58-9f0779f35a9f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] validate_networks() for [('5028f2a2-a7e7-4b29-9df9-5d7a5fdea67a', None, None, None, None, None)] {{(pid=118445) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 21:17:41.264537 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-e44dca60-03d5-428d-9a58-9f0779f35a9f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Flavor limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 21:17:41.265187 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-e44dca60-03d5-428d-9a58-9f0779f35a9f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Image limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 21:17:41.265835 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-e44dca60-03d5-428d-9a58-9f0779f35a9f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Flavor pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 21:17:41.266548 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-e44dca60-03d5-428d-9a58-9f0779f35a9f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Image pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 21:17:41.267155 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-e44dca60-03d5-428d-9a58-9f0779f35a9f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 21:17:41.277614 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e44dca60-03d5-428d-9a58-9f0779f35a9f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:41.278890 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e44dca60-03d5-428d-9a58-9f0779f35a9f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:41.279861 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e44dca60-03d5-428d-9a58-9f0779f35a9f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:41.280456 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e44dca60-03d5-428d-9a58-9f0779f35a9f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:41.307822 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-e44dca60-03d5-428d-9a58-9f0779f35a9f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Getting quotas for project 3ed08895dc72486783da247550696d4c. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:17:41.312538 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-e44dca60-03d5-428d-9a58-9f0779f35a9f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Getting quotas for user 72ad69b2fab34a6180d7353c1aa730d3 and project 3ed08895dc72486783da247550696d4c. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:17:41.383176 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-e44dca60-03d5-428d-9a58-9f0779f35a9f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Going to run 1 instances... {{(pid=118445) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 21:17:41.385495 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-e44dca60-03d5-428d-9a58-9f0779f35a9f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: 624d9206-aaf9-4556-872a-65131bf75741] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='94190149-fb43-4c34-af73-2de6fc43e5dd',volume_size=None,volume_type=None)] {{(pid=118445) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 21:17:41.595682 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-e44dca60-03d5-428d-9a58-9f0779f35a9f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.145574 Jul 13 21:17:41.596478 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 613/1204] 10.222.0.39 () {60 vars in 1146 bytes} [Wed Jul 13 21:17:40 2022] POST /compute/v2.1/servers => generated 404 bytes in 1147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 21:17:41.605346 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:17:41.605736 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell0:SELECT=4 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:17:41.607487 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:17:41.614256 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-06682a4b-baa9-4717-8260-1fe57ea68568 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:17:41.615573 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-06682a4b-baa9-4717-8260-1fe57ea68568 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: 624d9206-aaf9-4556-872a-65131bf75741] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:17:41.796972 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-06682a4b-baa9-4717-8260-1fe57ea68568 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:17:41.806966 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-06682a4b-baa9-4717-8260-1fe57ea68568 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741" status: 200 len: 1094 microversion: 2.1 time: 0.204205 Jul 13 21:17:41.811518 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 592/1205] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:17:41 2022] GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741 => generated 1094 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:17:42.834929 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c077b1f8-a658-441e-8afd-06568d37af18 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:17:42.839063 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-c077b1f8-a658-441e-8afd-06568d37af18 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: 624d9206-aaf9-4556-872a-65131bf75741] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:17:42.853926 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c077b1f8-a658-441e-8afd-06568d37af18 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:42.854371 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c077b1f8-a658-441e-8afd-06568d37af18 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:42.855171 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c077b1f8-a658-441e-8afd-06568d37af18 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:42.855982 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c077b1f8-a658-441e-8afd-06568d37af18 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:42.943548 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c077b1f8-a658-441e-8afd-06568d37af18 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:17:42.952911 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-c077b1f8-a658-441e-8afd-06568d37af18 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741" status: 200 len: 1192 microversion: 2.1 time: 0.122559 Jul 13 21:17:42.953495 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 614/1206] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:17:42 2022] GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741 => generated 1192 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:17:43.971012 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-474760d9-ab64-4e4a-a5d2-9fb7d89a4dde tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:17:43.971782 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-474760d9-ab64-4e4a-a5d2-9fb7d89a4dde tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: 624d9206-aaf9-4556-872a-65131bf75741] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:17:43.982664 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-474760d9-ab64-4e4a-a5d2-9fb7d89a4dde tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:43.984531 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-474760d9-ab64-4e4a-a5d2-9fb7d89a4dde tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:43.985539 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-474760d9-ab64-4e4a-a5d2-9fb7d89a4dde tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:43.985993 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-474760d9-ab64-4e4a-a5d2-9fb7d89a4dde tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:44.121160 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-474760d9-ab64-4e4a-a5d2-9fb7d89a4dde tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:17:44.130261 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-474760d9-ab64-4e4a-a5d2-9fb7d89a4dde tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741" status: 200 len: 1198 microversion: 2.1 time: 0.163670 Jul 13 21:17:44.130864 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 593/1207] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:17:43 2022] GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741 => generated 1198 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:17:45.112484 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-47c690b5-277c-4762-a3b3-9d49e0227f2e req-06fbbbcc-65c4-44b8-b7aa-1b5bc1523541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "624d9206-aaf9-4556-872a-65131bf75741", "tag": "43776720-a6fd-43f0-8e48-417e13f5708d"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:17:45.131962 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-47c690b5-277c-4762-a3b3-9d49e0227f2e req-06fbbbcc-65c4-44b8-b7aa-1b5bc1523541 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:45.134386 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-47c690b5-277c-4762-a3b3-9d49e0227f2e req-06fbbbcc-65c4-44b8-b7aa-1b5bc1523541 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:45.151475 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-2537a3a3-59ae-4747-81d6-3ee1b2940008 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:17:45.154127 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-2537a3a3-59ae-4747-81d6-3ee1b2940008 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: 624d9206-aaf9-4556-872a-65131bf75741] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:17:45.168981 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-47c690b5-277c-4762-a3b3-9d49e0227f2e req-06fbbbcc-65c4-44b8-b7aa-1b5bc1523541 service nova] Creating event network-changed:43776720-a6fd-43f0-8e48-417e13f5708d for instance 624d9206-aaf9-4556-872a-65131bf75741 on hv-cinder-79987 Jul 13 21:17:45.173609 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2537a3a3-59ae-4747-81d6-3ee1b2940008 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:45.174163 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2537a3a3-59ae-4747-81d6-3ee1b2940008 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:45.175030 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2537a3a3-59ae-4747-81d6-3ee1b2940008 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:45.175477 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2537a3a3-59ae-4747-81d6-3ee1b2940008 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:45.182278 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-47c690b5-277c-4762-a3b3-9d49e0227f2e req-06fbbbcc-65c4-44b8-b7aa-1b5bc1523541 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072623 Jul 13 21:17:45.183433 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 615/1208] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:17:45.522090 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-2537a3a3-59ae-4747-81d6-3ee1b2940008 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:17:45.533119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-2537a3a3-59ae-4747-81d6-3ee1b2940008 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741" status: 200 len: 1264 microversion: 2.1 time: 0.386143 Jul 13 21:17:45.534363 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 594/1209] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:17:45 2022] GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741 => generated 1264 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:17:46.549888 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-a47ddba8-f959-47a1-b3de-dfec9836bf80 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:17:46.551459 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-a47ddba8-f959-47a1-b3de-dfec9836bf80 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: 624d9206-aaf9-4556-872a-65131bf75741] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:17:46.559482 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a47ddba8-f959-47a1-b3de-dfec9836bf80 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:46.561322 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a47ddba8-f959-47a1-b3de-dfec9836bf80 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:46.562531 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a47ddba8-f959-47a1-b3de-dfec9836bf80 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:46.563657 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a47ddba8-f959-47a1-b3de-dfec9836bf80 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:46.919924 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-a47ddba8-f959-47a1-b3de-dfec9836bf80 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:17:46.929188 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-a47ddba8-f959-47a1-b3de-dfec9836bf80 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741" status: 200 len: 1264 microversion: 2.1 time: 0.382994 Jul 13 21:17:46.930675 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 616/1210] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:17:46 2022] GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741 => generated 1264 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:17:47.952068 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-fb8f4d52-fea5-43ea-b5b6-664a457eeb95 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:17:47.952678 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-fb8f4d52-fea5-43ea-b5b6-664a457eeb95 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: 624d9206-aaf9-4556-872a-65131bf75741] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:17:47.963477 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fb8f4d52-fea5-43ea-b5b6-664a457eeb95 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:47.963931 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fb8f4d52-fea5-43ea-b5b6-664a457eeb95 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:47.964903 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fb8f4d52-fea5-43ea-b5b6-664a457eeb95 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:47.965372 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fb8f4d52-fea5-43ea-b5b6-664a457eeb95 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:48.202555 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-fb8f4d52-fea5-43ea-b5b6-664a457eeb95 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:17:48.215005 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-fb8f4d52-fea5-43ea-b5b6-664a457eeb95 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741" status: 200 len: 1264 microversion: 2.1 time: 0.267716 Jul 13 21:17:48.222401 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 595/1211] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:17:47 2022] GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741 => generated 1264 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:17:49.239260 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c3442924-63b8-4362-b77f-cb2cc85090df tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:17:49.239984 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-c3442924-63b8-4362-b77f-cb2cc85090df tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: 624d9206-aaf9-4556-872a-65131bf75741] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:17:49.247406 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c3442924-63b8-4362-b77f-cb2cc85090df tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:49.247852 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c3442924-63b8-4362-b77f-cb2cc85090df tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:49.248621 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c3442924-63b8-4362-b77f-cb2cc85090df tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:49.249180 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c3442924-63b8-4362-b77f-cb2cc85090df tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:49.406082 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c3442924-63b8-4362-b77f-cb2cc85090df tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:17:49.413580 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-c3442924-63b8-4362-b77f-cb2cc85090df tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741" status: 200 len: 1264 microversion: 2.1 time: 0.178515 Jul 13 21:17:49.414165 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 617/1212] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:17:49 2022] GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:17:49.594601 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-c7ba25f0-f7e9-47b9-aec0-70113dc92703 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Action: 'create', calling method: .version_select at 0x7f96e88d2e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-1919820440", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSnj53q8V/KCtaUy9yv/MQKgCROEICgZHvRPUpvYZ5XkBIqr0e5knAFX70lG/okISzIZv5jy7JT5NcyrD0QXb/p13+HX7N4HJyH+tFxHMe0wS9qWB3ObgsIU6+sH/3v8g=="}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:17:49.611474 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.quota [None req-c7ba25f0-f7e9-47b9-aec0-70113dc92703 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Getting quotas for project 59ed37e30e7b4a7188823efe184af5a1. Resources: {'key_pairs'} {{(pid=118444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:17:49.615272 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.quota [None req-c7ba25f0-f7e9-47b9-aec0-70113dc92703 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Getting quotas for user 262475732e324ecbbf1bb54c33fcc425 and project 59ed37e30e7b4a7188823efe184af5a1. Resources: {'key_pairs'} {{(pid=118444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:17:49.639575 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-c7ba25f0-f7e9-47b9-aec0-70113dc92703 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.214962 Jul 13 21:17:49.640160 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 596/1213] 10.222.0.39 () {60 vars in 1158 bytes} [Wed Jul 13 21:17:49 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:17:50.431692 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-bb982902-8c4c-48cf-aa06-014928b5d64b tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:17:50.432259 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-bb982902-8c4c-48cf-aa06-014928b5d64b tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: 624d9206-aaf9-4556-872a-65131bf75741] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:17:50.443846 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bb982902-8c4c-48cf-aa06-014928b5d64b tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:50.443846 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bb982902-8c4c-48cf-aa06-014928b5d64b tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:50.443846 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bb982902-8c4c-48cf-aa06-014928b5d64b tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:50.443846 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-bb982902-8c4c-48cf-aa06-014928b5d64b tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:50.636179 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-bb982902-8c4c-48cf-aa06-014928b5d64b tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:17:50.644495 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-bb982902-8c4c-48cf-aa06-014928b5d64b tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741" status: 200 len: 1264 microversion: 2.1 time: 0.218212 Jul 13 21:17:50.645074 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 618/1214] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:17:50 2022] GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741 => generated 1264 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:17:51.662212 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-373a2a18-7809-42b7-9678-bb985faa9c16 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:17:51.662846 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-373a2a18-7809-42b7-9678-bb985faa9c16 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: 624d9206-aaf9-4556-872a-65131bf75741] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:17:51.682912 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-373a2a18-7809-42b7-9678-bb985faa9c16 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:51.683364 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-373a2a18-7809-42b7-9678-bb985faa9c16 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:51.684891 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-373a2a18-7809-42b7-9678-bb985faa9c16 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:51.685490 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-373a2a18-7809-42b7-9678-bb985faa9c16 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:51.832817 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-373a2a18-7809-42b7-9678-bb985faa9c16 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:17:51.841117 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-373a2a18-7809-42b7-9678-bb985faa9c16 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741" status: 200 len: 1264 microversion: 2.1 time: 0.183248 Jul 13 21:17:51.841717 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 597/1215] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:17:51 2022] GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741 => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:17:52.857912 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-2c08e9e2-0574-46ab-b770-2ff478ef9868 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:17:52.858538 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-2c08e9e2-0574-46ab-b770-2ff478ef9868 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: 624d9206-aaf9-4556-872a-65131bf75741] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:17:52.860519 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=2 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:17:52.861168 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=6 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:17:52.867371 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2c08e9e2-0574-46ab-b770-2ff478ef9868 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:52.867819 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2c08e9e2-0574-46ab-b770-2ff478ef9868 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:52.868591 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2c08e9e2-0574-46ab-b770-2ff478ef9868 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:52.869027 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-2c08e9e2-0574-46ab-b770-2ff478ef9868 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:53.007390 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-2c08e9e2-0574-46ab-b770-2ff478ef9868 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:17:53.016454 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-2c08e9e2-0574-46ab-b770-2ff478ef9868 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741" status: 200 len: 1264 microversion: 2.1 time: 0.162920 Jul 13 21:17:53.017114 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 619/1216] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:17:52 2022] GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:17:54.033804 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-fb1db6f0-0596-43fd-b833-617fbc21b200 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:17:54.034703 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-fb1db6f0-0596-43fd-b833-617fbc21b200 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: 624d9206-aaf9-4556-872a-65131bf75741] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:17:54.041343 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fb1db6f0-0596-43fd-b833-617fbc21b200 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:54.041921 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fb1db6f0-0596-43fd-b833-617fbc21b200 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:54.042813 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fb1db6f0-0596-43fd-b833-617fbc21b200 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:54.043834 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fb1db6f0-0596-43fd-b833-617fbc21b200 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:54.189352 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-fb1db6f0-0596-43fd-b833-617fbc21b200 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:17:54.197158 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-fb1db6f0-0596-43fd-b833-617fbc21b200 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741" status: 200 len: 1264 microversion: 2.1 time: 0.167715 Jul 13 21:17:54.197739 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 598/1217] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:17:54 2022] GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:17:55.213596 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-1cbe6b70-b511-4123-8ba0-457ce1a5d58c tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:17:55.214214 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-1cbe6b70-b511-4123-8ba0-457ce1a5d58c tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: 624d9206-aaf9-4556-872a-65131bf75741] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:17:55.221732 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1cbe6b70-b511-4123-8ba0-457ce1a5d58c tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:55.222191 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1cbe6b70-b511-4123-8ba0-457ce1a5d58c tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:55.225261 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1cbe6b70-b511-4123-8ba0-457ce1a5d58c tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:55.225736 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1cbe6b70-b511-4123-8ba0-457ce1a5d58c tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:55.361980 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-1cbe6b70-b511-4123-8ba0-457ce1a5d58c tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:17:55.369434 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-1cbe6b70-b511-4123-8ba0-457ce1a5d58c tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741" status: 200 len: 1264 microversion: 2.1 time: 0.159770 Jul 13 21:17:55.370002 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 620/1218] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:17:55 2022] GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:17:55.969662 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-3c669076-9b30-4c2a-be15-39acf9804c91 req-82af6943-e873-4021-b7d0-acd0d7342570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "624d9206-aaf9-4556-872a-65131bf75741", "name": "network-vif-plugged", "status": "completed", "tag": "43776720-a6fd-43f0-8e48-417e13f5708d"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:17:55.978635 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-3c669076-9b30-4c2a-be15-39acf9804c91 req-82af6943-e873-4021-b7d0-acd0d7342570 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:55.979109 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-3c669076-9b30-4c2a-be15-39acf9804c91 req-82af6943-e873-4021-b7d0-acd0d7342570 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:55.992776 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-3c669076-9b30-4c2a-be15-39acf9804c91 req-82af6943-e873-4021-b7d0-acd0d7342570 service nova] Creating event network-vif-plugged:43776720-a6fd-43f0-8e48-417e13f5708d for instance 624d9206-aaf9-4556-872a-65131bf75741 on hv-cinder-79987 Jul 13 21:17:55.998191 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-3c669076-9b30-4c2a-be15-39acf9804c91 req-82af6943-e873-4021-b7d0-acd0d7342570 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032836 Jul 13 21:17:55.998829 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 599/1219] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:17:56.386929 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-945f0a77-8ea7-4bec-afc1-7292f72cce11 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:17:56.387793 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-945f0a77-8ea7-4bec-afc1-7292f72cce11 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: 624d9206-aaf9-4556-872a-65131bf75741] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:17:56.394401 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-945f0a77-8ea7-4bec-afc1-7292f72cce11 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:56.394880 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-945f0a77-8ea7-4bec-afc1-7292f72cce11 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:56.395649 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-945f0a77-8ea7-4bec-afc1-7292f72cce11 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:56.396081 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-945f0a77-8ea7-4bec-afc1-7292f72cce11 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:56.526795 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-945f0a77-8ea7-4bec-afc1-7292f72cce11 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:17:56.534584 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-945f0a77-8ea7-4bec-afc1-7292f72cce11 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741" status: 200 len: 1264 microversion: 2.1 time: 0.151757 Jul 13 21:17:56.535171 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 621/1220] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:17:56 2022] GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:17:57.553169 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-4a8a7731-ea57-4c93-b806-efe68ef9d4a7 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:17:57.553772 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-4a8a7731-ea57-4c93-b806-efe68ef9d4a7 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: 624d9206-aaf9-4556-872a-65131bf75741] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:17:57.560978 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4a8a7731-ea57-4c93-b806-efe68ef9d4a7 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:57.561422 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4a8a7731-ea57-4c93-b806-efe68ef9d4a7 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:57.562162 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4a8a7731-ea57-4c93-b806-efe68ef9d4a7 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:57.562593 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-4a8a7731-ea57-4c93-b806-efe68ef9d4a7 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:57.694519 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-4a8a7731-ea57-4c93-b806-efe68ef9d4a7 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:17:57.702846 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-4a8a7731-ea57-4c93-b806-efe68ef9d4a7 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741" status: 200 len: 1264 microversion: 2.1 time: 0.153872 Jul 13 21:17:57.703415 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 600/1221] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:17:57 2022] GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:17:58.720545 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-fd88cb5f-6e7d-48b7-bd32-9ba28eafd118 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:17:58.721153 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-fd88cb5f-6e7d-48b7-bd32-9ba28eafd118 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: 624d9206-aaf9-4556-872a-65131bf75741] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:17:58.727258 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-fd88cb5f-6e7d-48b7-bd32-9ba28eafd118 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:58.727702 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-fd88cb5f-6e7d-48b7-bd32-9ba28eafd118 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:58.728466 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-fd88cb5f-6e7d-48b7-bd32-9ba28eafd118 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:58.728887 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-fd88cb5f-6e7d-48b7-bd32-9ba28eafd118 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:58.860368 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-fd88cb5f-6e7d-48b7-bd32-9ba28eafd118 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:17:58.868115 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-fd88cb5f-6e7d-48b7-bd32-9ba28eafd118 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741" status: 200 len: 1450 microversion: 2.1 time: 0.151935 Jul 13 21:17:58.868683 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 622/1222] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:17:58 2022] GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:17:58.883837 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-46d66e69-570c-4c35-a496-7181154feab6 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:17:58.884447 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-46d66e69-570c-4c35-a496-7181154feab6 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: 624d9206-aaf9-4556-872a-65131bf75741] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:17:58.891654 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-46d66e69-570c-4c35-a496-7181154feab6 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:58.892102 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-46d66e69-570c-4c35-a496-7181154feab6 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:58.892859 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-46d66e69-570c-4c35-a496-7181154feab6 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:17:58.893288 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-46d66e69-570c-4c35-a496-7181154feab6 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:17:59.024327 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-46d66e69-570c-4c35-a496-7181154feab6 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:17:59.033187 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-46d66e69-570c-4c35-a496-7181154feab6 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741" status: 200 len: 1450 microversion: 2.1 time: 0.152988 Jul 13 21:17:59.033774 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 601/1223] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:17:58 2022] GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:18:01.023036 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-d50c4913-aadd-4834-a90c-1fc6621cf603 req-8f840f72-54a1-4853-ba03-ce674bbcf90e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "624d9206-aaf9-4556-872a-65131bf75741", "tag": "43776720-a6fd-43f0-8e48-417e13f5708d"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:18:01.031336 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-d50c4913-aadd-4834-a90c-1fc6621cf603 req-8f840f72-54a1-4853-ba03-ce674bbcf90e service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:01.031773 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-d50c4913-aadd-4834-a90c-1fc6621cf603 req-8f840f72-54a1-4853-ba03-ce674bbcf90e service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:01.043190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-d50c4913-aadd-4834-a90c-1fc6621cf603 req-8f840f72-54a1-4853-ba03-ce674bbcf90e service nova] Creating event network-changed:43776720-a6fd-43f0-8e48-417e13f5708d for instance 624d9206-aaf9-4556-872a-65131bf75741 on hv-cinder-79987 Jul 13 21:18:01.048624 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-d50c4913-aadd-4834-a90c-1fc6621cf603 req-8f840f72-54a1-4853-ba03-ce674bbcf90e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029518 Jul 13 21:18:01.049375 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 623/1224] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:18:03.514869 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 13 21:18:03.514869 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Wed Jul 13 21:18:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 13 21:18:11.077286 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-7c0206a6-a548-4b38-a79e-8fac136a33b3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-61755551", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1919820440", "security_groups": [{"name": "tempest-secgroup-smoke-1684190117"}], "networks": [{"uuid": "848b71da-2f85-433f-86cf-4c61bd19d9cb"}], "block_device_mapping_v2": [{"uuid": "690b0733-8e0b-4008-8c05-a5882c7446d0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:18:11.086082 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell0:SELECT=6 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:18:11.087334 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:18:11.087968 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=44 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:18:11.200622 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.network.neutron [None req-7c0206a6-a548-4b38-a79e-8fac136a33b3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] validate_networks() for [('848b71da-2f85-433f-86cf-4c61bd19d9cb', None, None, None, None, None)] {{(pid=118444) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 21:18:11.556695 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.virt.hardware [None req-7c0206a6-a548-4b38-a79e-8fac136a33b3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Flavor limits 0:0:0 {{(pid=118444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 21:18:11.557120 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.virt.hardware [None req-7c0206a6-a548-4b38-a79e-8fac136a33b3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Image limits 0:0:0 {{(pid=118444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 21:18:11.557600 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.virt.hardware [None req-7c0206a6-a548-4b38-a79e-8fac136a33b3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Flavor pref 0:0:0 {{(pid=118444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 21:18:11.558010 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.virt.hardware [None req-7c0206a6-a548-4b38-a79e-8fac136a33b3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Image pref 0:0:0 {{(pid=118444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 21:18:11.558453 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.virt.hardware [None req-7c0206a6-a548-4b38-a79e-8fac136a33b3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 21:18:11.567951 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7c0206a6-a548-4b38-a79e-8fac136a33b3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:11.568409 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7c0206a6-a548-4b38-a79e-8fac136a33b3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:11.569202 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7c0206a6-a548-4b38-a79e-8fac136a33b3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:11.569647 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7c0206a6-a548-4b38-a79e-8fac136a33b3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:11.585827 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.quota [None req-7c0206a6-a548-4b38-a79e-8fac136a33b3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Getting quotas for project 59ed37e30e7b4a7188823efe184af5a1. Resources: {'cores', 'instances', 'ram'} {{(pid=118444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:18:11.590087 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.quota [None req-7c0206a6-a548-4b38-a79e-8fac136a33b3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Getting quotas for user 262475732e324ecbbf1bb54c33fcc425 and project 59ed37e30e7b4a7188823efe184af5a1. Resources: {'cores', 'instances', 'ram'} {{(pid=118444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:18:11.645525 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-7c0206a6-a548-4b38-a79e-8fac136a33b3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Going to run 1 instances... {{(pid=118444) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 21:18:11.647658 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-7c0206a6-a548-4b38-a79e-8fac136a33b3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='690b0733-8e0b-4008-8c05-a5882c7446d0',volume_size=None,volume_type=None)] {{(pid=118444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 21:18:11.773864 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-7c0206a6-a548-4b38-a79e-8fac136a33b3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.700323 Jul 13 21:18:11.774492 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 602/1225] 10.222.0.39 () {60 vars in 1146 bytes} [Wed Jul 13 21:18:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 21:18:11.782220 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:18:11.783547 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=54 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:18:11.789825 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ef84caf0-8f55-4892-9303-684cbe7a63fe tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:18:11.791364 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ef84caf0-8f55-4892-9303-684cbe7a63fe tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:18:11.853532 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ef84caf0-8f55-4892-9303-684cbe7a63fe tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:18:11.862489 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ef84caf0-8f55-4892-9303-684cbe7a63fe tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1087 microversion: 2.1 time: 0.080785 Jul 13 21:18:11.863090 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 624/1226] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:18:11 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1087 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:18:12.879361 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-bb8796c6-40af-467f-a81d-fe950b7de3fa tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:18:12.879969 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-bb8796c6-40af-467f-a81d-fe950b7de3fa tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:18:12.886206 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bb8796c6-40af-467f-a81d-fe950b7de3fa tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:12.886685 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bb8796c6-40af-467f-a81d-fe950b7de3fa tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:12.887478 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bb8796c6-40af-467f-a81d-fe950b7de3fa tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:12.887922 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bb8796c6-40af-467f-a81d-fe950b7de3fa tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:12.965914 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-bb8796c6-40af-467f-a81d-fe950b7de3fa tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:18:12.973374 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-bb8796c6-40af-467f-a81d-fe950b7de3fa tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1203 microversion: 2.1 time: 0.098848 Jul 13 21:18:12.973947 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 603/1227] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:18:12 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1203 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:18:13.991242 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-17d28cfb-bcfc-4ac7-aa7c-016a4caaabd3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:18:13.992753 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-17d28cfb-bcfc-4ac7-aa7c-016a4caaabd3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:18:13.999324 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-17d28cfb-bcfc-4ac7-aa7c-016a4caaabd3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:13.999801 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-17d28cfb-bcfc-4ac7-aa7c-016a4caaabd3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:14.000563 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-17d28cfb-bcfc-4ac7-aa7c-016a4caaabd3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:14.000989 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-17d28cfb-bcfc-4ac7-aa7c-016a4caaabd3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:14.145889 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-17d28cfb-bcfc-4ac7-aa7c-016a4caaabd3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:18:14.153976 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-17d28cfb-bcfc-4ac7-aa7c-016a4caaabd3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1259 microversion: 2.1 time: 0.167381 Jul 13 21:18:14.155679 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 625/1228] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:18:13 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:18:14.216254 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-c7c0345d-a703-47f0-a4cd-524d7cd8c86e req-781b62c3-7108-4fcf-87bd-9d2e7dc0e705 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "780360c5-d271-4882-898a-443bb25a21a9", "tag": "ba158579-8748-42a9-bc6c-738c1c9a78ab"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:18:14.227463 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-c7c0345d-a703-47f0-a4cd-524d7cd8c86e req-781b62c3-7108-4fcf-87bd-9d2e7dc0e705 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:14.229928 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-c7c0345d-a703-47f0-a4cd-524d7cd8c86e req-781b62c3-7108-4fcf-87bd-9d2e7dc0e705 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:14.245030 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-c7c0345d-a703-47f0-a4cd-524d7cd8c86e req-781b62c3-7108-4fcf-87bd-9d2e7dc0e705 service nova] Creating event network-changed:ba158579-8748-42a9-bc6c-738c1c9a78ab for instance 780360c5-d271-4882-898a-443bb25a21a9 on hv-cinder-79987 Jul 13 21:18:14.250454 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-c7c0345d-a703-47f0-a4cd-524d7cd8c86e req-781b62c3-7108-4fcf-87bd-9d2e7dc0e705 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037663 Jul 13 21:18:14.251661 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 604/1229] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:18:15.172667 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-1fd03eb0-ca9f-466e-a467-2f0035720c79 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:18:15.173263 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-1fd03eb0-ca9f-466e-a467-2f0035720c79 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:18:15.185955 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1fd03eb0-ca9f-466e-a467-2f0035720c79 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:15.186402 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1fd03eb0-ca9f-466e-a467-2f0035720c79 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:15.187197 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1fd03eb0-ca9f-466e-a467-2f0035720c79 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:15.187651 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-1fd03eb0-ca9f-466e-a467-2f0035720c79 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:15.318890 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-1fd03eb0-ca9f-466e-a467-2f0035720c79 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:18:15.326271 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-1fd03eb0-ca9f-466e-a467-2f0035720c79 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1259 microversion: 2.1 time: 0.158105 Jul 13 21:18:15.326852 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 626/1230] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:18:15 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:18:16.344680 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b320ed02-88a5-4b29-a53c-fb1f4079a7f0 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:18:16.345377 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b320ed02-88a5-4b29-a53c-fb1f4079a7f0 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:18:16.351588 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b320ed02-88a5-4b29-a53c-fb1f4079a7f0 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:16.352038 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b320ed02-88a5-4b29-a53c-fb1f4079a7f0 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:16.352794 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b320ed02-88a5-4b29-a53c-fb1f4079a7f0 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:16.353229 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b320ed02-88a5-4b29-a53c-fb1f4079a7f0 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:16.482710 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b320ed02-88a5-4b29-a53c-fb1f4079a7f0 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:18:16.490668 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b320ed02-88a5-4b29-a53c-fb1f4079a7f0 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1259 microversion: 2.1 time: 0.151294 Jul 13 21:18:16.491232 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 605/1231] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:18:16 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:18:17.506941 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-4675bdf9-41c4-471f-ac57-a610a64285b5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:18:17.507539 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-4675bdf9-41c4-471f-ac57-a610a64285b5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:18:17.514179 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4675bdf9-41c4-471f-ac57-a610a64285b5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:17.514637 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4675bdf9-41c4-471f-ac57-a610a64285b5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:17.515413 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4675bdf9-41c4-471f-ac57-a610a64285b5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:17.515819 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-4675bdf9-41c4-471f-ac57-a610a64285b5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:17.645437 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-4675bdf9-41c4-471f-ac57-a610a64285b5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:18:17.652896 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-4675bdf9-41c4-471f-ac57-a610a64285b5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1259 microversion: 2.1 time: 0.149715 Jul 13 21:18:17.653458 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 627/1232] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:18:17 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:18:18.669627 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-bf2e227f-7d0c-4113-bd5f-9e05971b1642 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:18:18.670239 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-bf2e227f-7d0c-4113-bd5f-9e05971b1642 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:18:18.676667 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bf2e227f-7d0c-4113-bd5f-9e05971b1642 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:18.677119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bf2e227f-7d0c-4113-bd5f-9e05971b1642 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:18.677878 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bf2e227f-7d0c-4113-bd5f-9e05971b1642 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:18.678319 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bf2e227f-7d0c-4113-bd5f-9e05971b1642 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:18.810855 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-bf2e227f-7d0c-4113-bd5f-9e05971b1642 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:18:18.818584 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-bf2e227f-7d0c-4113-bd5f-9e05971b1642 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1259 microversion: 2.1 time: 0.152845 Jul 13 21:18:18.819158 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 606/1233] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:18:18 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:18:19.836404 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-556795c8-ed7b-441b-bfd2-c15bb661c909 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:18:19.837002 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-556795c8-ed7b-441b-bfd2-c15bb661c909 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:18:19.843442 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-556795c8-ed7b-441b-bfd2-c15bb661c909 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:19.844467 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-556795c8-ed7b-441b-bfd2-c15bb661c909 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:19.845276 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-556795c8-ed7b-441b-bfd2-c15bb661c909 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:19.845659 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-556795c8-ed7b-441b-bfd2-c15bb661c909 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:19.977484 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-556795c8-ed7b-441b-bfd2-c15bb661c909 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:18:19.984934 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-556795c8-ed7b-441b-bfd2-c15bb661c909 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1259 microversion: 2.1 time: 0.152412 Jul 13 21:18:19.985487 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 628/1234] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:18:19 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:18:21.002150 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-9678d603-e376-4c05-ba1e-c351080804ea tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:18:21.002789 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-9678d603-e376-4c05-ba1e-c351080804ea tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:18:21.009372 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9678d603-e376-4c05-ba1e-c351080804ea tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:21.009821 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9678d603-e376-4c05-ba1e-c351080804ea tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:21.010871 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9678d603-e376-4c05-ba1e-c351080804ea tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:21.011312 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9678d603-e376-4c05-ba1e-c351080804ea tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:21.136835 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-9678d603-e376-4c05-ba1e-c351080804ea tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:18:21.144791 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-9678d603-e376-4c05-ba1e-c351080804ea tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1259 microversion: 2.1 time: 0.146966 Jul 13 21:18:21.145359 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 607/1235] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:18:20 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:18:22.162114 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c8284ad2-f6c5-4f8f-b047-709d9f4ff0e5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:18:22.162671 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-c8284ad2-f6c5-4f8f-b047-709d9f4ff0e5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:18:22.164966 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=2 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:18:22.170217 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c8284ad2-f6c5-4f8f-b047-709d9f4ff0e5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:22.170686 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c8284ad2-f6c5-4f8f-b047-709d9f4ff0e5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:22.171457 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c8284ad2-f6c5-4f8f-b047-709d9f4ff0e5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:22.171932 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c8284ad2-f6c5-4f8f-b047-709d9f4ff0e5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:22.309085 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c8284ad2-f6c5-4f8f-b047-709d9f4ff0e5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:18:22.317152 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-c8284ad2-f6c5-4f8f-b047-709d9f4ff0e5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1259 microversion: 2.1 time: 0.158950 Jul 13 21:18:22.317719 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 629/1236] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:18:22 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:18:23.334149 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-f5dc3f67-21d5-4429-8abf-cd2c281e5924 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:18:23.334784 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-f5dc3f67-21d5-4429-8abf-cd2c281e5924 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:18:23.336714 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell0:SELECT=2 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:18:23.337386 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell0:SELECT=6 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:18:23.343011 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f5dc3f67-21d5-4429-8abf-cd2c281e5924 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:23.344167 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f5dc3f67-21d5-4429-8abf-cd2c281e5924 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:23.344696 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f5dc3f67-21d5-4429-8abf-cd2c281e5924 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:23.345132 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-f5dc3f67-21d5-4429-8abf-cd2c281e5924 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:23.475432 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-f5dc3f67-21d5-4429-8abf-cd2c281e5924 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:18:23.482822 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-f5dc3f67-21d5-4429-8abf-cd2c281e5924 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1259 microversion: 2.1 time: 0.152639 Jul 13 21:18:23.483540 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 608/1237] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:18:23 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:18:24.127637 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-15be44f3-d21b-4514-bb9e-b20d6b321ca2 req-4eb079f0-215f-4654-b4b9-83b92ef4e7bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "780360c5-d271-4882-898a-443bb25a21a9", "name": "network-vif-plugged", "status": "completed", "tag": "ba158579-8748-42a9-bc6c-738c1c9a78ab"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:18:24.136825 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-15be44f3-d21b-4514-bb9e-b20d6b321ca2 req-4eb079f0-215f-4654-b4b9-83b92ef4e7bc service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:24.137271 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-15be44f3-d21b-4514-bb9e-b20d6b321ca2 req-4eb079f0-215f-4654-b4b9-83b92ef4e7bc service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:24.148648 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-15be44f3-d21b-4514-bb9e-b20d6b321ca2 req-4eb079f0-215f-4654-b4b9-83b92ef4e7bc service nova] Creating event network-vif-plugged:ba158579-8748-42a9-bc6c-738c1c9a78ab for instance 780360c5-d271-4882-898a-443bb25a21a9 on hv-cinder-79987 Jul 13 21:18:24.153664 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-15be44f3-d21b-4514-bb9e-b20d6b321ca2 req-4eb079f0-215f-4654-b4b9-83b92ef4e7bc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030236 Jul 13 21:18:24.154300 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 630/1238] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:18:24.500820 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-25c9e854-4b8c-414c-8857-52adc406c8e3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:18:24.501432 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-25c9e854-4b8c-414c-8857-52adc406c8e3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:18:24.507906 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-25c9e854-4b8c-414c-8857-52adc406c8e3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:24.508358 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-25c9e854-4b8c-414c-8857-52adc406c8e3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:24.509123 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-25c9e854-4b8c-414c-8857-52adc406c8e3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:24.509563 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-25c9e854-4b8c-414c-8857-52adc406c8e3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:24.639743 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-25c9e854-4b8c-414c-8857-52adc406c8e3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:18:24.647499 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-25c9e854-4b8c-414c-8857-52adc406c8e3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1259 microversion: 2.1 time: 0.151093 Jul 13 21:18:24.648062 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 609/1239] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:18:24 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:18:25.664705 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-6b6b59f0-4299-4c96-97cd-37b91426e3dc tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:18:25.665398 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-6b6b59f0-4299-4c96-97cd-37b91426e3dc tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:18:25.672068 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6b6b59f0-4299-4c96-97cd-37b91426e3dc tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:25.672510 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6b6b59f0-4299-4c96-97cd-37b91426e3dc tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:25.673261 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6b6b59f0-4299-4c96-97cd-37b91426e3dc tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:25.673691 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6b6b59f0-4299-4c96-97cd-37b91426e3dc tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:25.801332 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-6b6b59f0-4299-4c96-97cd-37b91426e3dc tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:18:25.808707 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-6b6b59f0-4299-4c96-97cd-37b91426e3dc tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1259 microversion: 2.1 time: 0.148625 Jul 13 21:18:25.809266 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 631/1240] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:18:25 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:18:26.825159 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-692c4d44-10bd-4739-a20e-a97dc263b8a3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:18:26.825809 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-692c4d44-10bd-4739-a20e-a97dc263b8a3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:18:26.832790 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-692c4d44-10bd-4739-a20e-a97dc263b8a3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:26.833234 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-692c4d44-10bd-4739-a20e-a97dc263b8a3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:26.833980 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-692c4d44-10bd-4739-a20e-a97dc263b8a3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:26.834409 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-692c4d44-10bd-4739-a20e-a97dc263b8a3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:26.961173 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-692c4d44-10bd-4739-a20e-a97dc263b8a3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:18:26.968618 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-692c4d44-10bd-4739-a20e-a97dc263b8a3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1443 microversion: 2.1 time: 0.147254 Jul 13 21:18:26.969183 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 610/1241] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:18:26 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1443 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:18:26.984316 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-6fc5c9ba-709d-480f-b0f9-aa31cce344bd tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:18:26.984917 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-6fc5c9ba-709d-480f-b0f9-aa31cce344bd tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:18:26.991266 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6fc5c9ba-709d-480f-b0f9-aa31cce344bd tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:26.991710 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6fc5c9ba-709d-480f-b0f9-aa31cce344bd tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:26.992462 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6fc5c9ba-709d-480f-b0f9-aa31cce344bd tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:26.992897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6fc5c9ba-709d-480f-b0f9-aa31cce344bd tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:27.124466 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-6fc5c9ba-709d-480f-b0f9-aa31cce344bd tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:18:27.132405 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-6fc5c9ba-709d-480f-b0f9-aa31cce344bd tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1443 microversion: 2.1 time: 0.151854 Jul 13 21:18:27.132970 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 632/1242] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:18:26 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1443 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:18:28.708083 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-70a30d98-e94b-4aad-ac1b-4f97b7e39ec9 req-30ba04ec-5e7d-4563-811b-a3149df44d4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "780360c5-d271-4882-898a-443bb25a21a9", "tag": "ba158579-8748-42a9-bc6c-738c1c9a78ab"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:18:28.718933 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-70a30d98-e94b-4aad-ac1b-4f97b7e39ec9 req-30ba04ec-5e7d-4563-811b-a3149df44d4f service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:18:28.719737 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-70a30d98-e94b-4aad-ac1b-4f97b7e39ec9 req-30ba04ec-5e7d-4563-811b-a3149df44d4f service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:18:28.733816 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-70a30d98-e94b-4aad-ac1b-4f97b7e39ec9 req-30ba04ec-5e7d-4563-811b-a3149df44d4f service nova] Creating event network-changed:ba158579-8748-42a9-bc6c-738c1c9a78ab for instance 780360c5-d271-4882-898a-443bb25a21a9 on hv-cinder-79987 Jul 13 21:18:28.739557 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-70a30d98-e94b-4aad-ac1b-4f97b7e39ec9 req-30ba04ec-5e7d-4563-811b-a3149df44d4f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035349 Jul 13 21:18:28.740169 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 611/1243] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 21:20:14.744413 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f5bd381f-b7e0-46bd-a87b-8fcc2af701e4] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 13 21:20:14.745231 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_api:SELECT=20 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:20:14.745983 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=44 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:20:14.749774 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-5f18ba9e-0eb2-4240-8235-9c612651c916 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:14.750260 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-5f18ba9e-0eb2-4240-8235-9c612651c916 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: 624d9206-aaf9-4556-872a-65131bf75741] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:14.757461 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5f18ba9e-0eb2-4240-8235-9c612651c916 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:14.757901 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5f18ba9e-0eb2-4240-8235-9c612651c916 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:14.758680 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5f18ba9e-0eb2-4240-8235-9c612651c916 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:14.759113 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5f18ba9e-0eb2-4240-8235-9c612651c916 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:14.783960 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-5f18ba9e-0eb2-4240-8235-9c612651c916 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: 624d9206-aaf9-4556-872a-65131bf75741] Going to try to terminate instance {{(pid=118445) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 21:20:14.860677 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-5f18ba9e-0eb2-4240-8235-9c612651c916 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "DELETE /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741" status: 204 len: 0 microversion: 2.1 time: 0.117958 Jul 13 21:20:14.861250 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 633/1244] 10.222.0.39 () {58 vars in 1238 bytes} [Wed Jul 13 21:20:14 2022] DELETE /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 21:20:14.867740 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8815b97f-8584-45a6-a46d-24520423f2c4] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 13 21:20:14.868331 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:20:14.869115 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=48 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:20:14.873314 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-e40fc3ac-bcdb-4e0a-9114-94d2af1d1912 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:14.873998 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-e40fc3ac-bcdb-4e0a-9114-94d2af1d1912 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: 624d9206-aaf9-4556-872a-65131bf75741] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:14.882632 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e40fc3ac-bcdb-4e0a-9114-94d2af1d1912 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:14.883111 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e40fc3ac-bcdb-4e0a-9114-94d2af1d1912 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:14.883860 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e40fc3ac-bcdb-4e0a-9114-94d2af1d1912 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:14.884288 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e40fc3ac-bcdb-4e0a-9114-94d2af1d1912 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:15.063031 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-e40fc3ac-bcdb-4e0a-9114-94d2af1d1912 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:15.071154 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-e40fc3ac-bcdb-4e0a-9114-94d2af1d1912 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741" status: 200 len: 1575 microversion: 2.1 time: 0.205233 Jul 13 21:20:15.071708 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 612/1245] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:14 2022] GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741 => generated 1575 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:16.089402 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-d518967e-59b6-4873-82cf-547be7ccca3c tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:16.090031 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-d518967e-59b6-4873-82cf-547be7ccca3c tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: 624d9206-aaf9-4556-872a-65131bf75741] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:16.097793 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d518967e-59b6-4873-82cf-547be7ccca3c tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:16.098874 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d518967e-59b6-4873-82cf-547be7ccca3c tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:16.099632 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d518967e-59b6-4873-82cf-547be7ccca3c tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:16.100063 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-d518967e-59b6-4873-82cf-547be7ccca3c tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:16.105268 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO oslo.messaging._drivers.impl_rabbit [-] [f5bd381f-b7e0-46bd-a87b-8fcc2af701e4] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 55454. Jul 13 21:20:16.283396 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-d518967e-59b6-4873-82cf-547be7ccca3c tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:16.290846 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-d518967e-59b6-4873-82cf-547be7ccca3c tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741" status: 200 len: 1575 microversion: 2.1 time: 0.205703 Jul 13 21:20:16.291407 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 634/1246] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:16 2022] GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741 => generated 1575 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:17.308001 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-1ef0141a-d252-42d5-b543-5f5909dab2cf tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:17.308629 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-1ef0141a-d252-42d5-b543-5f5909dab2cf tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: 624d9206-aaf9-4556-872a-65131bf75741] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:17.316316 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1ef0141a-d252-42d5-b543-5f5909dab2cf tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:17.316617 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1ef0141a-d252-42d5-b543-5f5909dab2cf tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:17.317379 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1ef0141a-d252-42d5-b543-5f5909dab2cf tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:17.317810 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1ef0141a-d252-42d5-b543-5f5909dab2cf tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:17.334442 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO oslo.messaging._drivers.impl_rabbit [-] [8815b97f-8584-45a6-a46d-24520423f2c4] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 55462. Jul 13 21:20:17.397432 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-1ef0141a-d252-42d5-b543-5f5909dab2cf tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:17.404890 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-1ef0141a-d252-42d5-b543-5f5909dab2cf tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741" status: 200 len: 1509 microversion: 2.1 time: 0.100831 Jul 13 21:20:17.405488 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 613/1247] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:17 2022] GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741 => generated 1509 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:17.504048 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-2b8beb58-2689-43e7-a1fc-1dc6d35b3c96 req-c5da6a31-9201-4010-856a-f44b1c5076c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "624d9206-aaf9-4556-872a-65131bf75741", "name": "network-vif-deleted", "tag": "43776720-a6fd-43f0-8e48-417e13f5708d"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:20:17.513190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-2b8beb58-2689-43e7-a1fc-1dc6d35b3c96 req-c5da6a31-9201-4010-856a-f44b1c5076c8 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:17.513629 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-2b8beb58-2689-43e7-a1fc-1dc6d35b3c96 req-c5da6a31-9201-4010-856a-f44b1c5076c8 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:17.525596 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-2b8beb58-2689-43e7-a1fc-1dc6d35b3c96 req-c5da6a31-9201-4010-856a-f44b1c5076c8 service nova] Creating event network-vif-deleted:43776720-a6fd-43f0-8e48-417e13f5708d for instance 624d9206-aaf9-4556-872a-65131bf75741 on hv-cinder-79987 Jul 13 21:20:17.530596 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-2b8beb58-2689-43e7-a1fc-1dc6d35b3c96 req-c5da6a31-9201-4010-856a-f44b1c5076c8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030246 Jul 13 21:20:17.531442 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 635/1248] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:20:18.423134 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-1f62811e-324a-49a5-af9b-18c174c1eb88 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:18.423753 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-1f62811e-324a-49a5-af9b-18c174c1eb88 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: 624d9206-aaf9-4556-872a-65131bf75741] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:18.431410 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1f62811e-324a-49a5-af9b-18c174c1eb88 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:18.431813 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1f62811e-324a-49a5-af9b-18c174c1eb88 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:18.432593 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1f62811e-324a-49a5-af9b-18c174c1eb88 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:18.433034 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1f62811e-324a-49a5-af9b-18c174c1eb88 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:18.446512 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.wsgi [None req-1f62811e-324a-49a5-af9b-18c174c1eb88 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] HTTP exception thrown: Instance 624d9206-aaf9-4556-872a-65131bf75741 could not be found. Jul 13 21:20:18.448197 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-1f62811e-324a-49a5-af9b-18c174c1eb88 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Request method failure captured: Jul 13 21:20:18.448197 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: request: GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741 HTTP/1.1 Jul 13 21:20:18.448197 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept: application/json Jul 13 21:20:18.448197 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Accept-Encoding: identity Jul 13 21:20:18.448197 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Connection: close Jul 13 21:20:18.448197 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Length: 0 Jul 13 21:20:18.448197 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Content-Type: application/json Jul 13 21:20:18.448197 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Host: 10.222.0.39 Jul 13 21:20:18.448197 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Openstack-System-Scope: None Jul 13 21:20:18.448197 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: User-Agent: python-urllib3/1.26.9 Jul 13 21:20:18.448197 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Auth-Token: gAAAAABizzZUuW8Wylop2uUj_ZalhrmWi8pObcpx_Q6kPrbX8mWv9kYcHP4gAOp9zkV1ANobh6lhRcZuKvGUjS6ddxBCBFp1srej2b-4Et2Lr2theRmBLDTkJ_aMXKHrB08cSmfYAgn3VCldO5ExvnQrJuVsobgqDuprlEtmEi0uzhPrXpuKvwc Jul 13 21:20:18.448197 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Id: None Jul 13 21:20:18.448197 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Domain-Name: None Jul 13 21:20:18.448197 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Identity-Status: Confirmed Jul 13 21:20:18.448197 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Is-Admin-Project: True Jul 13 21:20:18.448197 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Id: default Jul 13 21:20:18.448197 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Domain-Name: Default Jul 13 21:20:18.448197 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Id: 3ed08895dc72486783da247550696d4c Jul 13 21:20:18.448197 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Project-Name: tempest-TestVolumeBootPattern-1525868514 Jul 13 21:20:18.448197 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Role: member,reader Jul 13 21:20:18.448197 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Roles: member,reader Jul 13 21:20:18.450037 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3ed08895dc72486783da247550696d4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3ed08895dc72486783da247550696d4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3ed08895dc72486783da247550696d4c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3ed08895dc72486783da247550696d4c"}]}] Jul 13 21:20:18.450037 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant: tempest-TestVolumeBootPattern-1525868514 Jul 13 21:20:18.450037 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Id: 3ed08895dc72486783da247550696d4c Jul 13 21:20:18.450037 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-Tenant-Name: tempest-TestVolumeBootPattern-1525868514 Jul 13 21:20:18.450037 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User: tempest-TestVolumeBootPattern-1525868514-project Jul 13 21:20:18.450037 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Id: default Jul 13 21:20:18.450037 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Domain-Name: Default Jul 13 21:20:18.450037 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Id: 72ad69b2fab34a6180d7353c1aa730d3 Jul 13 21:20:18.450037 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: X-User-Name: tempest-TestVolumeBootPattern-1525868514-project Jul 13 21:20:18.450037 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: method: > Jul 13 21:20:18.450037 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: exception: Instance 624d9206-aaf9-4556-872a-65131bf75741 could not be found. Jul 13 21:20:18.450037 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: action_args: {'id': '624d9206-aaf9-4556-872a-65131bf75741'} Jul 13 21:20:18.451034 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:20:18.451034 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:20:18.451034 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:20:18.451034 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:20:18.451034 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:20:18.451034 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:20:18.451034 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:20:18.451034 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:20:18.451034 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:20:18.451034 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:20:18.451034 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 624d9206-aaf9-4556-872a-65131bf75741 could not be found. Jul 13 21:20:18.451034 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:20:18.451034 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:20:18.451034 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:20:18.451034 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:20:18.451034 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:20:18.451034 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:20:18.451034 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:20:18.451034 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:20:18.451034 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:20:18.452481 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:20:18.452481 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 21:20:18.452481 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 21:20:18.452481 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:20:18.452481 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:20:18.452481 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:20:18.452481 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:20:18.452481 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 624d9206-aaf9-4556-872a-65131bf75741 could not be found. Jul 13 21:20:18.452481 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:20:18.452481 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:20:18.452481 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:20:18.452481 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:20:18.452481 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:20:18.452481 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:20:18.452481 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:20:18.452481 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:20:18.452481 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 624d9206-aaf9-4556-872a-65131bf75741 could not be found. Jul 13 21:20:18.452481 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR nova.api.openstack.wsgi Jul 13 21:20:18.453805 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-1f62811e-324a-49a5-af9b-18c174c1eb88 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Returning 404 to user: Instance 624d9206-aaf9-4556-872a-65131bf75741 could not be found. {{(pid=118444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:20:18.453805 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-1f62811e-324a-49a5-af9b-18c174c1eb88 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741" status: 404 len: 111 microversion: 2.1 time: 0.030827 Jul 13 21:20:18.453805 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 614/1249] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:18 2022] GET /compute/v2.1/servers/624d9206-aaf9-4556-872a-65131bf75741 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:20:18.548393 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-b6335451-691e-4d53-b9e1-a8ce23a84d45 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-584558319", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1311636940", "security_groups": [{"name": "tempest-secgroup-smoke-30976695"}], "block_device_mapping_v2": [{"uuid": "94190149-fb43-4c34-af73-2de6fc43e5dd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5028f2a2-a7e7-4b29-9df9-5d7a5fdea67a"}]}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:20:18.657316 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.network.neutron [None req-b6335451-691e-4d53-b9e1-a8ce23a84d45 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] validate_networks() for [('5028f2a2-a7e7-4b29-9df9-5d7a5fdea67a', None, None, None, None, None)] {{(pid=118445) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 21:20:19.016566 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-b6335451-691e-4d53-b9e1-a8ce23a84d45 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Flavor limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 21:20:19.016990 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-b6335451-691e-4d53-b9e1-a8ce23a84d45 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Image limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 21:20:19.017458 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-b6335451-691e-4d53-b9e1-a8ce23a84d45 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Flavor pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 21:20:19.017864 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-b6335451-691e-4d53-b9e1-a8ce23a84d45 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Image pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 21:20:19.018272 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-b6335451-691e-4d53-b9e1-a8ce23a84d45 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 21:20:19.027631 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b6335451-691e-4d53-b9e1-a8ce23a84d45 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:19.028073 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b6335451-691e-4d53-b9e1-a8ce23a84d45 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:19.028860 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b6335451-691e-4d53-b9e1-a8ce23a84d45 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:19.029295 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b6335451-691e-4d53-b9e1-a8ce23a84d45 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:19.046850 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-b6335451-691e-4d53-b9e1-a8ce23a84d45 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Getting quotas for project 3ed08895dc72486783da247550696d4c. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:20:19.050751 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-b6335451-691e-4d53-b9e1-a8ce23a84d45 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Getting quotas for user 72ad69b2fab34a6180d7353c1aa730d3 and project 3ed08895dc72486783da247550696d4c. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:20:19.105694 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-b6335451-691e-4d53-b9e1-a8ce23a84d45 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Going to run 1 instances... {{(pid=118445) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 21:20:19.107884 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-b6335451-691e-4d53-b9e1-a8ce23a84d45 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: e03d7cdc-e637-4754-849c-641558ed7a49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='94190149-fb43-4c34-af73-2de6fc43e5dd',volume_size=None,volume_type=None)] {{(pid=118445) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 21:20:19.229690 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-b6335451-691e-4d53-b9e1-a8ce23a84d45 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.685990 Jul 13 21:20:19.230323 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 636/1250] 10.222.0.39 () {60 vars in 1146 bytes} [Wed Jul 13 21:20:18 2022] POST /compute/v2.1/servers => generated 404 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 21:20:19.240407 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-6fa79a2a-4db9-47eb-816b-4805f9f6355d tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:19.241125 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-6fa79a2a-4db9-47eb-816b-4805f9f6355d tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: e03d7cdc-e637-4754-849c-641558ed7a49] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:19.295081 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-6fa79a2a-4db9-47eb-816b-4805f9f6355d tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:19.301652 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-6fa79a2a-4db9-47eb-816b-4805f9f6355d tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49" status: 200 len: 1094 microversion: 2.1 time: 0.065326 Jul 13 21:20:19.302246 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 615/1251] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:19 2022] GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:20.319259 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ff2b5eea-5bb7-4890-9732-057c8e5b6a43 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:20.319874 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ff2b5eea-5bb7-4890-9732-057c8e5b6a43 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: e03d7cdc-e637-4754-849c-641558ed7a49] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:20.328051 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ff2b5eea-5bb7-4890-9732-057c8e5b6a43 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:20.328556 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ff2b5eea-5bb7-4890-9732-057c8e5b6a43 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:20.329361 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ff2b5eea-5bb7-4890-9732-057c8e5b6a43 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:20.329797 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ff2b5eea-5bb7-4890-9732-057c8e5b6a43 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:20.398841 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ff2b5eea-5bb7-4890-9732-057c8e5b6a43 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:20.406323 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ff2b5eea-5bb7-4890-9732-057c8e5b6a43 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49" status: 200 len: 1210 microversion: 2.1 time: 0.091922 Jul 13 21:20:20.406940 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 637/1252] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:20 2022] GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49 => generated 1210 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:21.423677 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b1408487-1a19-46ed-978a-27f412b0677c tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:21.425072 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b1408487-1a19-46ed-978a-27f412b0677c tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: e03d7cdc-e637-4754-849c-641558ed7a49] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:21.433495 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b1408487-1a19-46ed-978a-27f412b0677c tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:21.433944 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b1408487-1a19-46ed-978a-27f412b0677c tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:21.434733 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b1408487-1a19-46ed-978a-27f412b0677c tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:21.435167 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b1408487-1a19-46ed-978a-27f412b0677c tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:21.609206 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-e413a5b1-6053-4116-903c-77061a3cdf4e req-0ba623e5-3f57-467d-9a51-525e2b57110d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e03d7cdc-e637-4754-849c-641558ed7a49", "tag": "999c1ba7-725a-477d-8359-4583664dd62b"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:20:21.625922 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-e413a5b1-6053-4116-903c-77061a3cdf4e req-0ba623e5-3f57-467d-9a51-525e2b57110d service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:21.626358 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-e413a5b1-6053-4116-903c-77061a3cdf4e req-0ba623e5-3f57-467d-9a51-525e2b57110d service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:21.638225 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-e413a5b1-6053-4116-903c-77061a3cdf4e req-0ba623e5-3f57-467d-9a51-525e2b57110d service nova] Creating event network-changed:999c1ba7-725a-477d-8359-4583664dd62b for instance e03d7cdc-e637-4754-849c-641558ed7a49 on hv-cinder-79987 Jul 13 21:20:21.643942 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-e413a5b1-6053-4116-903c-77061a3cdf4e req-0ba623e5-3f57-467d-9a51-525e2b57110d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044900 Jul 13 21:20:21.644545 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 638/1253] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:20:21.655917 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b1408487-1a19-46ed-978a-27f412b0677c tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:21.664236 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b1408487-1a19-46ed-978a-27f412b0677c tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49" status: 200 len: 1264 microversion: 2.1 time: 0.244662 Jul 13 21:20:21.664803 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 616/1254] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:21 2022] GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49 => generated 1264 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:22.682719 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-9696ab98-4b95-4ad1-986c-0acc8833df48 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:22.683439 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-9696ab98-4b95-4ad1-986c-0acc8833df48 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: e03d7cdc-e637-4754-849c-641558ed7a49] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:22.689621 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9696ab98-4b95-4ad1-986c-0acc8833df48 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:22.690062 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9696ab98-4b95-4ad1-986c-0acc8833df48 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:22.690855 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9696ab98-4b95-4ad1-986c-0acc8833df48 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:22.691292 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-9696ab98-4b95-4ad1-986c-0acc8833df48 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:22.819526 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-9696ab98-4b95-4ad1-986c-0acc8833df48 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:22.827023 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-9696ab98-4b95-4ad1-986c-0acc8833df48 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49" status: 200 len: 1264 microversion: 2.1 time: 0.148880 Jul 13 21:20:22.827598 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 639/1255] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:22 2022] GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:23.843784 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-027655d4-1b24-4cf4-9caf-199431354c27 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:23.844411 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-027655d4-1b24-4cf4-9caf-199431354c27 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: e03d7cdc-e637-4754-849c-641558ed7a49] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:23.850868 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-027655d4-1b24-4cf4-9caf-199431354c27 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:23.851320 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-027655d4-1b24-4cf4-9caf-199431354c27 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:23.852079 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-027655d4-1b24-4cf4-9caf-199431354c27 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:23.852548 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-027655d4-1b24-4cf4-9caf-199431354c27 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:23.978064 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-027655d4-1b24-4cf4-9caf-199431354c27 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:23.985434 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-027655d4-1b24-4cf4-9caf-199431354c27 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49" status: 200 len: 1264 microversion: 2.1 time: 0.145463 Jul 13 21:20:23.985994 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 617/1256] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:23 2022] GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49 => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:25.002562 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-cefb6ce2-6c59-4d7f-a3cd-7d31db804160 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:25.003181 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-cefb6ce2-6c59-4d7f-a3cd-7d31db804160 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: e03d7cdc-e637-4754-849c-641558ed7a49] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:25.009839 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-cefb6ce2-6c59-4d7f-a3cd-7d31db804160 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:25.010277 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-cefb6ce2-6c59-4d7f-a3cd-7d31db804160 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:25.011063 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-cefb6ce2-6c59-4d7f-a3cd-7d31db804160 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:25.011486 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-cefb6ce2-6c59-4d7f-a3cd-7d31db804160 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:25.138891 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-cefb6ce2-6c59-4d7f-a3cd-7d31db804160 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:25.146842 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-cefb6ce2-6c59-4d7f-a3cd-7d31db804160 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49" status: 200 len: 1264 microversion: 2.1 time: 0.147427 Jul 13 21:20:25.147401 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 640/1257] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:24 2022] GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:26.163962 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-935fa096-cce0-40bf-85df-08aac80ab835 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:26.164759 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-935fa096-cce0-40bf-85df-08aac80ab835 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: e03d7cdc-e637-4754-849c-641558ed7a49] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:26.171452 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-935fa096-cce0-40bf-85df-08aac80ab835 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:26.171907 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-935fa096-cce0-40bf-85df-08aac80ab835 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:26.172666 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-935fa096-cce0-40bf-85df-08aac80ab835 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:26.173105 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-935fa096-cce0-40bf-85df-08aac80ab835 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:26.299606 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-935fa096-cce0-40bf-85df-08aac80ab835 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:26.307075 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-935fa096-cce0-40bf-85df-08aac80ab835 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49" status: 200 len: 1264 microversion: 2.1 time: 0.147840 Jul 13 21:20:26.307645 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 618/1258] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:26 2022] GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:27.324314 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-52703230-3739-472e-8eae-42a7b582ca76 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:27.324909 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-52703230-3739-472e-8eae-42a7b582ca76 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: e03d7cdc-e637-4754-849c-641558ed7a49] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:27.331574 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-52703230-3739-472e-8eae-42a7b582ca76 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:27.332153 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-52703230-3739-472e-8eae-42a7b582ca76 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:27.332919 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-52703230-3739-472e-8eae-42a7b582ca76 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:27.333358 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-52703230-3739-472e-8eae-42a7b582ca76 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:27.461292 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-52703230-3739-472e-8eae-42a7b582ca76 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:27.468630 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-52703230-3739-472e-8eae-42a7b582ca76 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49" status: 200 len: 1264 microversion: 2.1 time: 0.148127 Jul 13 21:20:27.469177 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 641/1259] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:27 2022] GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:28.485076 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-79bd3991-258a-4e40-ad84-12f4941f1162 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:28.485610 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-79bd3991-258a-4e40-ad84-12f4941f1162 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: e03d7cdc-e637-4754-849c-641558ed7a49] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:28.492802 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-79bd3991-258a-4e40-ad84-12f4941f1162 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:28.493257 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-79bd3991-258a-4e40-ad84-12f4941f1162 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:28.494111 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-79bd3991-258a-4e40-ad84-12f4941f1162 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:28.494558 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-79bd3991-258a-4e40-ad84-12f4941f1162 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:28.625449 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-79bd3991-258a-4e40-ad84-12f4941f1162 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:28.633223 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-79bd3991-258a-4e40-ad84-12f4941f1162 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49" status: 200 len: 1264 microversion: 2.1 time: 0.152045 Jul 13 21:20:28.633798 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 619/1260] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:28 2022] GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:29.649246 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-8fb9b3bc-8a12-40e5-84be-b92d87592354 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:29.649847 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8fb9b3bc-8a12-40e5-84be-b92d87592354 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: e03d7cdc-e637-4754-849c-641558ed7a49] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:29.652296 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=2 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:20:29.652942 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=6 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:20:29.658834 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8fb9b3bc-8a12-40e5-84be-b92d87592354 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:29.659280 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8fb9b3bc-8a12-40e5-84be-b92d87592354 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:29.660062 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8fb9b3bc-8a12-40e5-84be-b92d87592354 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:29.660491 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8fb9b3bc-8a12-40e5-84be-b92d87592354 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:29.790333 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8fb9b3bc-8a12-40e5-84be-b92d87592354 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:29.797822 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-8fb9b3bc-8a12-40e5-84be-b92d87592354 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49" status: 200 len: 1264 microversion: 2.1 time: 0.152511 Jul 13 21:20:29.798388 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 642/1261] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:29 2022] GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:30.815139 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-bdacdc6f-73b0-4ba7-b205-6025e421dd3f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:30.815833 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-bdacdc6f-73b0-4ba7-b205-6025e421dd3f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: e03d7cdc-e637-4754-849c-641558ed7a49] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:30.817824 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell0:SELECT=2 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:20:30.824183 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bdacdc6f-73b0-4ba7-b205-6025e421dd3f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:30.824627 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bdacdc6f-73b0-4ba7-b205-6025e421dd3f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:30.825383 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bdacdc6f-73b0-4ba7-b205-6025e421dd3f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:30.825814 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-bdacdc6f-73b0-4ba7-b205-6025e421dd3f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:30.959858 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-bdacdc6f-73b0-4ba7-b205-6025e421dd3f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:30.967350 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-bdacdc6f-73b0-4ba7-b205-6025e421dd3f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49" status: 200 len: 1264 microversion: 2.1 time: 0.156127 Jul 13 21:20:30.967912 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 620/1262] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:30 2022] GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:31.983989 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-8f914ee1-ef3f-45c5-9c9d-8564fe3d9da5 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:31.984525 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8f914ee1-ef3f-45c5-9c9d-8564fe3d9da5 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: e03d7cdc-e637-4754-849c-641558ed7a49] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:31.991008 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8f914ee1-ef3f-45c5-9c9d-8564fe3d9da5 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:31.991452 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8f914ee1-ef3f-45c5-9c9d-8564fe3d9da5 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:31.992216 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8f914ee1-ef3f-45c5-9c9d-8564fe3d9da5 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:31.992648 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8f914ee1-ef3f-45c5-9c9d-8564fe3d9da5 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:32.122443 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-8f914ee1-ef3f-45c5-9c9d-8564fe3d9da5 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:32.129796 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-8f914ee1-ef3f-45c5-9c9d-8564fe3d9da5 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49" status: 200 len: 1264 microversion: 2.1 time: 0.149722 Jul 13 21:20:32.130354 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 643/1263] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:31 2022] GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:32.714153 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-3f4b4aae-2935-4c26-a8e2-a534af58d474 req-bfddb705-87b9-4858-8a56-88f2af866c99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e03d7cdc-e637-4754-849c-641558ed7a49", "name": "network-vif-plugged", "status": "completed", "tag": "999c1ba7-725a-477d-8359-4583664dd62b"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:20:32.723107 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-3f4b4aae-2935-4c26-a8e2-a534af58d474 req-bfddb705-87b9-4858-8a56-88f2af866c99 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:32.723945 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-3f4b4aae-2935-4c26-a8e2-a534af58d474 req-bfddb705-87b9-4858-8a56-88f2af866c99 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:32.735560 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-3f4b4aae-2935-4c26-a8e2-a534af58d474 req-bfddb705-87b9-4858-8a56-88f2af866c99 service nova] Creating event network-vif-plugged:999c1ba7-725a-477d-8359-4583664dd62b for instance e03d7cdc-e637-4754-849c-641558ed7a49 on hv-cinder-79987 Jul 13 21:20:32.741127 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-3f4b4aae-2935-4c26-a8e2-a534af58d474 req-bfddb705-87b9-4858-8a56-88f2af866c99 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029990 Jul 13 21:20:32.742000 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 621/1264] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:20:33.147586 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-808b8228-3a8c-4762-9ff5-515913ed34f0 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:33.148201 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-808b8228-3a8c-4762-9ff5-515913ed34f0 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: e03d7cdc-e637-4754-849c-641558ed7a49] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:33.156250 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-808b8228-3a8c-4762-9ff5-515913ed34f0 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:33.156732 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-808b8228-3a8c-4762-9ff5-515913ed34f0 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:33.157594 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-808b8228-3a8c-4762-9ff5-515913ed34f0 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:33.158036 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-808b8228-3a8c-4762-9ff5-515913ed34f0 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:33.286738 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-808b8228-3a8c-4762-9ff5-515913ed34f0 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:33.294851 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-808b8228-3a8c-4762-9ff5-515913ed34f0 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49" status: 200 len: 1264 microversion: 2.1 time: 0.151600 Jul 13 21:20:33.295414 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 644/1265] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:33 2022] GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:34.312939 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-9a05a051-07e4-436b-9a4d-9709e20302be tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:34.313660 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-9a05a051-07e4-436b-9a4d-9709e20302be tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: e03d7cdc-e637-4754-849c-641558ed7a49] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:34.320332 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9a05a051-07e4-436b-9a4d-9709e20302be tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:34.320781 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9a05a051-07e4-436b-9a4d-9709e20302be tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:34.321537 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9a05a051-07e4-436b-9a4d-9709e20302be tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:34.321979 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-9a05a051-07e4-436b-9a4d-9709e20302be tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:34.455617 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-9a05a051-07e4-436b-9a4d-9709e20302be tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:34.463742 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-9a05a051-07e4-436b-9a4d-9709e20302be tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49" status: 200 len: 1264 microversion: 2.1 time: 0.155476 Jul 13 21:20:34.464303 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 622/1266] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:34 2022] GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:35.481359 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-183e4379-bf26-4326-b159-c4003436e012 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:35.481968 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-183e4379-bf26-4326-b159-c4003436e012 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: e03d7cdc-e637-4754-849c-641558ed7a49] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:35.488396 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-183e4379-bf26-4326-b159-c4003436e012 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:35.488844 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-183e4379-bf26-4326-b159-c4003436e012 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:35.489602 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-183e4379-bf26-4326-b159-c4003436e012 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:35.490031 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-183e4379-bf26-4326-b159-c4003436e012 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:35.616716 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-183e4379-bf26-4326-b159-c4003436e012 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:35.624056 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-183e4379-bf26-4326-b159-c4003436e012 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49" status: 200 len: 1451 microversion: 2.1 time: 0.146561 Jul 13 21:20:35.624616 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 645/1267] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:35 2022] GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49 => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:35.640405 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-177e41da-3b3b-43e2-b852-0cf913a7a608 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:35.641015 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-177e41da-3b3b-43e2-b852-0cf913a7a608 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: e03d7cdc-e637-4754-849c-641558ed7a49] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:35.647934 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-177e41da-3b3b-43e2-b852-0cf913a7a608 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:35.648385 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-177e41da-3b3b-43e2-b852-0cf913a7a608 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:35.649142 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-177e41da-3b3b-43e2-b852-0cf913a7a608 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:35.649574 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-177e41da-3b3b-43e2-b852-0cf913a7a608 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:35.774586 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-177e41da-3b3b-43e2-b852-0cf913a7a608 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:35.782258 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-177e41da-3b3b-43e2-b852-0cf913a7a608 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49" status: 200 len: 1451 microversion: 2.1 time: 0.145535 Jul 13 21:20:35.782786 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 623/1268] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:35 2022] GET /compute/v2.1/servers/e03d7cdc-e637-4754-849c-641558ed7a49 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:37.587123 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-54296d43-304f-41aa-ad6b-8595503ef7b2 req-25d9cbad-cccf-4d01-9316-2abef9f67863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e03d7cdc-e637-4754-849c-641558ed7a49", "tag": "999c1ba7-725a-477d-8359-4583664dd62b"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:20:37.595564 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-54296d43-304f-41aa-ad6b-8595503ef7b2 req-25d9cbad-cccf-4d01-9316-2abef9f67863 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:37.596009 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-54296d43-304f-41aa-ad6b-8595503ef7b2 req-25d9cbad-cccf-4d01-9316-2abef9f67863 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:37.606599 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-54296d43-304f-41aa-ad6b-8595503ef7b2 req-25d9cbad-cccf-4d01-9316-2abef9f67863 service nova] Creating event network-changed:999c1ba7-725a-477d-8359-4583664dd62b for instance e03d7cdc-e637-4754-849c-641558ed7a49 on hv-cinder-79987 Jul 13 21:20:37.611557 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-54296d43-304f-41aa-ad6b-8595503ef7b2 req-25d9cbad-cccf-4d01-9316-2abef9f67863 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028037 Jul 13 21:20:37.612497 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 646/1269] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:20:43.763395 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ba99fab6-87d2-4510-a9cc-e6bef6ce7b4b tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:20:43.763908 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-ba99fab6-87d2-4510-a9cc-e6bef6ce7b4b tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:43.770467 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ba99fab6-87d2-4510-a9cc-e6bef6ce7b4b tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:43.770939 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ba99fab6-87d2-4510-a9cc-e6bef6ce7b4b tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:43.771700 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ba99fab6-87d2-4510-a9cc-e6bef6ce7b4b tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:43.772136 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ba99fab6-87d2-4510-a9cc-e6bef6ce7b4b tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:43.794291 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.objects.instance [None req-ba99fab6-87d2-4510-a9cc-e6bef6ce7b4b tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lazy-loading 'flavor' on Instance uuid 780360c5-d271-4882-898a-443bb25a21a9 {{(pid=118444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:20:43.864891 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ba99fab6-87d2-4510-a9cc-e6bef6ce7b4b tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "POST /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9/action" status: 202 len: 0 microversion: 2.1 time: 0.105413 Jul 13 21:20:43.865505 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 624/1270] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Jul 13 21:20:43 2022] POST /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 21:20:43.875359 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-94a973b8-e5de-49b1-9c36-e883f3655a15 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:43.876655 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-94a973b8-e5de-49b1-9c36-e883f3655a15 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:43.883117 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-94a973b8-e5de-49b1-9c36-e883f3655a15 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:43.883653 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-94a973b8-e5de-49b1-9c36-e883f3655a15 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:43.884854 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-94a973b8-e5de-49b1-9c36-e883f3655a15 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:43.885311 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-94a973b8-e5de-49b1-9c36-e883f3655a15 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:44.016836 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-94a973b8-e5de-49b1-9c36-e883f3655a15 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:44.024414 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-94a973b8-e5de-49b1-9c36-e883f3655a15 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1568 microversion: 2.1 time: 0.153819 Jul 13 21:20:44.024973 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 647/1271] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:43 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:45.042656 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-981bfc06-ef85-45f2-8f79-01466b6ada08 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:45.043811 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-981bfc06-ef85-45f2-8f79-01466b6ada08 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:45.046836 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_api:SELECT=29 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:20:45.052360 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-981bfc06-ef85-45f2-8f79-01466b6ada08 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:45.052807 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-981bfc06-ef85-45f2-8f79-01466b6ada08 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:45.054085 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-981bfc06-ef85-45f2-8f79-01466b6ada08 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:45.054508 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-981bfc06-ef85-45f2-8f79-01466b6ada08 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:45.058524 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:20:45.185525 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-981bfc06-ef85-45f2-8f79-01466b6ada08 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:45.192956 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-981bfc06-ef85-45f2-8f79-01466b6ada08 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1568 microversion: 2.1 time: 0.155096 Jul 13 21:20:45.193529 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 625/1272] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:45 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:46.210770 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-76b5d191-479b-4ba0-bc07-897750011114 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:46.211378 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-76b5d191-479b-4ba0-bc07-897750011114 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:46.213367 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:20:46.218999 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-76b5d191-479b-4ba0-bc07-897750011114 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:46.219445 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-76b5d191-479b-4ba0-bc07-897750011114 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:46.220206 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-76b5d191-479b-4ba0-bc07-897750011114 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:46.220639 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-76b5d191-479b-4ba0-bc07-897750011114 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:46.226066 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:20:46.355568 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-76b5d191-479b-4ba0-bc07-897750011114 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:46.363092 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-76b5d191-479b-4ba0-bc07-897750011114 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1568 microversion: 2.1 time: 0.156389 Jul 13 21:20:46.363653 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 648/1273] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:46 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:47.380893 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-76b3f71b-ae20-4cca-a6a4-024e31f76e73 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:47.381534 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-76b3f71b-ae20-4cca-a6a4-024e31f76e73 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:47.388363 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-76b3f71b-ae20-4cca-a6a4-024e31f76e73 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:47.388811 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-76b3f71b-ae20-4cca-a6a4-024e31f76e73 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:47.389562 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-76b3f71b-ae20-4cca-a6a4-024e31f76e73 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:47.390000 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-76b3f71b-ae20-4cca-a6a4-024e31f76e73 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:47.522829 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-76b3f71b-ae20-4cca-a6a4-024e31f76e73 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:47.530302 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-76b3f71b-ae20-4cca-a6a4-024e31f76e73 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1568 microversion: 2.1 time: 0.153348 Jul 13 21:20:47.530838 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 626/1274] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:47 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:48.547190 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-dea5b53f-bf9d-4542-9ac3-7b8e37baf1d6 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:48.547795 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-dea5b53f-bf9d-4542-9ac3-7b8e37baf1d6 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:48.554204 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-dea5b53f-bf9d-4542-9ac3-7b8e37baf1d6 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:48.554667 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-dea5b53f-bf9d-4542-9ac3-7b8e37baf1d6 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:48.555423 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-dea5b53f-bf9d-4542-9ac3-7b8e37baf1d6 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:48.555855 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-dea5b53f-bf9d-4542-9ac3-7b8e37baf1d6 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:48.686306 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-dea5b53f-bf9d-4542-9ac3-7b8e37baf1d6 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:48.693774 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-dea5b53f-bf9d-4542-9ac3-7b8e37baf1d6 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1568 microversion: 2.1 time: 0.150438 Jul 13 21:20:48.694995 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 649/1275] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:48 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:49.711912 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-e89027e9-4146-4304-9c75-920348344f91 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:49.712546 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-e89027e9-4146-4304-9c75-920348344f91 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:49.719009 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e89027e9-4146-4304-9c75-920348344f91 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:49.719454 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e89027e9-4146-4304-9c75-920348344f91 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:49.720202 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e89027e9-4146-4304-9c75-920348344f91 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:49.720633 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e89027e9-4146-4304-9c75-920348344f91 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:49.850911 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-e89027e9-4146-4304-9c75-920348344f91 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:49.858248 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-e89027e9-4146-4304-9c75-920348344f91 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1568 microversion: 2.1 time: 0.150646 Jul 13 21:20:49.858836 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 627/1276] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:49 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:50.874327 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-e4784231-9783-43ea-ae6c-8026f92e6348 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:50.874939 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-e4784231-9783-43ea-ae6c-8026f92e6348 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:50.881973 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e4784231-9783-43ea-ae6c-8026f92e6348 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:50.882471 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e4784231-9783-43ea-ae6c-8026f92e6348 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:50.883282 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e4784231-9783-43ea-ae6c-8026f92e6348 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:50.883712 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-e4784231-9783-43ea-ae6c-8026f92e6348 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:51.009663 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-e4784231-9783-43ea-ae6c-8026f92e6348 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:51.017553 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-e4784231-9783-43ea-ae6c-8026f92e6348 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1568 microversion: 2.1 time: 0.147075 Jul 13 21:20:51.018116 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 650/1277] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:50 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:52.033479 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-0069b652-394f-4e7f-b416-006f197fb7de tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:52.034141 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-0069b652-394f-4e7f-b416-006f197fb7de tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:52.041164 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0069b652-394f-4e7f-b416-006f197fb7de tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:52.041605 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0069b652-394f-4e7f-b416-006f197fb7de tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:52.042348 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0069b652-394f-4e7f-b416-006f197fb7de tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:52.042803 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-0069b652-394f-4e7f-b416-006f197fb7de tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:52.174575 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-0069b652-394f-4e7f-b416-006f197fb7de tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:52.182033 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-0069b652-394f-4e7f-b416-006f197fb7de tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1568 microversion: 2.1 time: 0.152313 Jul 13 21:20:52.182596 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 628/1278] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:52 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:53.198382 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-72618bc3-af0b-4698-b92b-b088ec356646 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:53.199020 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-72618bc3-af0b-4698-b92b-b088ec356646 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:53.205421 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-72618bc3-af0b-4698-b92b-b088ec356646 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:53.205864 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-72618bc3-af0b-4698-b92b-b088ec356646 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:53.206649 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-72618bc3-af0b-4698-b92b-b088ec356646 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:53.207076 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-72618bc3-af0b-4698-b92b-b088ec356646 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:53.344157 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-72618bc3-af0b-4698-b92b-b088ec356646 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:53.352193 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-72618bc3-af0b-4698-b92b-b088ec356646 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1568 microversion: 2.1 time: 0.157681 Jul 13 21:20:53.352754 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 651/1279] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:53 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:54.369870 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-fe5b7709-4ed2-4732-be0b-38197423b26d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:54.370468 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-fe5b7709-4ed2-4732-be0b-38197423b26d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:54.377021 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fe5b7709-4ed2-4732-be0b-38197423b26d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:54.377465 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fe5b7709-4ed2-4732-be0b-38197423b26d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:54.378212 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fe5b7709-4ed2-4732-be0b-38197423b26d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:54.378661 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-fe5b7709-4ed2-4732-be0b-38197423b26d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:54.593109 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-fe5b7709-4ed2-4732-be0b-38197423b26d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:54.601033 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-fe5b7709-4ed2-4732-be0b-38197423b26d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1568 microversion: 2.1 time: 0.235134 Jul 13 21:20:54.601982 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 629/1280] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:54 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:55.618579 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-dd15b1ba-125d-44aa-b01d-158ce1f13fc4 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:55.619218 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-dd15b1ba-125d-44aa-b01d-158ce1f13fc4 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:55.625717 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-dd15b1ba-125d-44aa-b01d-158ce1f13fc4 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:55.626158 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-dd15b1ba-125d-44aa-b01d-158ce1f13fc4 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:55.626942 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-dd15b1ba-125d-44aa-b01d-158ce1f13fc4 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:55.627373 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-dd15b1ba-125d-44aa-b01d-158ce1f13fc4 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:55.753385 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-dd15b1ba-125d-44aa-b01d-158ce1f13fc4 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:55.761683 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-dd15b1ba-125d-44aa-b01d-158ce1f13fc4 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1568 microversion: 2.1 time: 0.147520 Jul 13 21:20:55.762253 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 652/1281] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:55 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:56.779182 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-8ea6627c-84ab-4a37-ab66-a53e312c02e4 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:56.779781 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-8ea6627c-84ab-4a37-ab66-a53e312c02e4 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:56.786149 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8ea6627c-84ab-4a37-ab66-a53e312c02e4 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:56.786590 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8ea6627c-84ab-4a37-ab66-a53e312c02e4 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:56.787362 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8ea6627c-84ab-4a37-ab66-a53e312c02e4 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:56.787791 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-8ea6627c-84ab-4a37-ab66-a53e312c02e4 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:56.918272 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-8ea6627c-84ab-4a37-ab66-a53e312c02e4 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:56.925665 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-8ea6627c-84ab-4a37-ab66-a53e312c02e4 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1568 microversion: 2.1 time: 0.150323 Jul 13 21:20:56.926228 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 630/1282] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:56 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:57.942998 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-15fa8d24-2310-43ab-86a6-80c041991133 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:57.943542 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-15fa8d24-2310-43ab-86a6-80c041991133 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:57.950022 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-15fa8d24-2310-43ab-86a6-80c041991133 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:57.950466 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-15fa8d24-2310-43ab-86a6-80c041991133 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:57.951254 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-15fa8d24-2310-43ab-86a6-80c041991133 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:57.951682 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-15fa8d24-2310-43ab-86a6-80c041991133 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:58.079584 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-15fa8d24-2310-43ab-86a6-80c041991133 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:58.086991 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-15fa8d24-2310-43ab-86a6-80c041991133 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1568 microversion: 2.1 time: 0.147820 Jul 13 21:20:58.087556 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 653/1283] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:57 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:20:59.103962 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-c95dc7b5-392b-4cda-9be2-245bc1c2bad3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:20:59.104556 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-c95dc7b5-392b-4cda-9be2-245bc1c2bad3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:20:59.110960 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c95dc7b5-392b-4cda-9be2-245bc1c2bad3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:59.111400 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c95dc7b5-392b-4cda-9be2-245bc1c2bad3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:59.112147 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c95dc7b5-392b-4cda-9be2-245bc1c2bad3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:20:59.112576 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c95dc7b5-392b-4cda-9be2-245bc1c2bad3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:20:59.295231 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-c95dc7b5-392b-4cda-9be2-245bc1c2bad3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:20:59.302640 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-c95dc7b5-392b-4cda-9be2-245bc1c2bad3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1568 microversion: 2.1 time: 0.202973 Jul 13 21:20:59.303245 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 631/1284] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:20:59 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1568 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:21:00.319659 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-41d9f0a7-9b18-45c8-8988-6459f31cc7f5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:21:00.320377 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-41d9f0a7-9b18-45c8-8988-6459f31cc7f5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:21:00.327528 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-41d9f0a7-9b18-45c8-8988-6459f31cc7f5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:00.327965 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-41d9f0a7-9b18-45c8-8988-6459f31cc7f5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:00.328715 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-41d9f0a7-9b18-45c8-8988-6459f31cc7f5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:00.329143 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-41d9f0a7-9b18-45c8-8988-6459f31cc7f5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:00.461301 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-41d9f0a7-9b18-45c8-8988-6459f31cc7f5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:21:00.468589 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-41d9f0a7-9b18-45c8-8988-6459f31cc7f5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1568 microversion: 2.1 time: 0.152751 Jul 13 21:21:00.469156 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 654/1285] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:21:00 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:21:01.486156 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-866ae99c-ab7c-4506-a98b-7f3644f8edd1 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:21:01.486757 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-866ae99c-ab7c-4506-a98b-7f3644f8edd1 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:21:01.493713 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-866ae99c-ab7c-4506-a98b-7f3644f8edd1 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:01.494167 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-866ae99c-ab7c-4506-a98b-7f3644f8edd1 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:01.494953 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-866ae99c-ab7c-4506-a98b-7f3644f8edd1 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:01.495394 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-866ae99c-ab7c-4506-a98b-7f3644f8edd1 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:01.627149 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-866ae99c-ab7c-4506-a98b-7f3644f8edd1 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:21:01.635615 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-866ae99c-ab7c-4506-a98b-7f3644f8edd1 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1568 microversion: 2.1 time: 0.153221 Jul 13 21:21:01.636181 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 632/1286] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:21:01 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:21:02.653587 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-98617e47-3025-400d-b3ca-2cf72b19a26b tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:21:02.654187 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-98617e47-3025-400d-b3ca-2cf72b19a26b tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:21:02.660656 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-98617e47-3025-400d-b3ca-2cf72b19a26b tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:02.661092 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-98617e47-3025-400d-b3ca-2cf72b19a26b tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:02.661839 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-98617e47-3025-400d-b3ca-2cf72b19a26b tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:02.662264 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-98617e47-3025-400d-b3ca-2cf72b19a26b tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:02.791898 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-98617e47-3025-400d-b3ca-2cf72b19a26b tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:21:02.799212 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-98617e47-3025-400d-b3ca-2cf72b19a26b tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1509 microversion: 2.1 time: 0.149402 Jul 13 21:21:02.799775 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 655/1287] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:21:02 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:21:02.815251 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-c4acf8e0-4267-4736-a84a-13656301094f tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:21:02.815812 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-c4acf8e0-4267-4736-a84a-13656301094f tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:21:02.822707 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c4acf8e0-4267-4736-a84a-13656301094f tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:02.823152 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c4acf8e0-4267-4736-a84a-13656301094f tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:02.823905 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c4acf8e0-4267-4736-a84a-13656301094f tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:02.824339 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c4acf8e0-4267-4736-a84a-13656301094f tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:02.897138 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c4acf8e0-4267-4736-a84a-13656301094f tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [bc223bd2-ec30-4174-a3e8-5fcd72663901] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 13 21:21:03.905138 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO oslo.messaging._drivers.impl_rabbit [None req-c4acf8e0-4267-4736-a84a-13656301094f tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [bc223bd2-ec30-4174-a3e8-5fcd72663901] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 55582. Jul 13 21:21:03.908585 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-c4acf8e0-4267-4736-a84a-13656301094f tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "POST /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9/action" status: 202 len: 0 microversion: 2.1 time: 1.097263 Jul 13 21:21:03.909226 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 633/1288] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Jul 13 21:21:02 2022] POST /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9/action => generated 0 bytes in 1098 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 13 21:21:03.917723 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-a1a97399-1bc2-4d70-b51b-0e1f46db9ce9 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:21:03.918325 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-a1a97399-1bc2-4d70-b51b-0e1f46db9ce9 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:21:03.924825 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a1a97399-1bc2-4d70-b51b-0e1f46db9ce9 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:03.925205 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a1a97399-1bc2-4d70-b51b-0e1f46db9ce9 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:03.925962 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a1a97399-1bc2-4d70-b51b-0e1f46db9ce9 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:03.926760 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a1a97399-1bc2-4d70-b51b-0e1f46db9ce9 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:04.100569 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-a1a97399-1bc2-4d70-b51b-0e1f46db9ce9 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:21:04.108157 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-a1a97399-1bc2-4d70-b51b-0e1f46db9ce9 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1517 microversion: 2.1 time: 0.194864 Jul 13 21:21:04.108723 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 656/1289] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:21:03 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1517 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:21:04.795515 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-e07a4ea3-0134-47d9-9906-2cb5d5579b09 req-82889892-677f-417b-a79e-c4b5e02a4ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "780360c5-d271-4882-898a-443bb25a21a9", "name": "network-vif-unplugged", "status": "completed", "tag": "ba158579-8748-42a9-bc6c-738c1c9a78ab"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:21:04.803652 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-e07a4ea3-0134-47d9-9906-2cb5d5579b09 req-82889892-677f-417b-a79e-c4b5e02a4ef2 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:04.804637 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-e07a4ea3-0134-47d9-9906-2cb5d5579b09 req-82889892-677f-417b-a79e-c4b5e02a4ef2 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:04.815785 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.compute.server_external_events [req-e07a4ea3-0134-47d9-9906-2cb5d5579b09 req-82889892-677f-417b-a79e-c4b5e02a4ef2 service nova] Unable to find a host for instance 780360c5-d271-4882-898a-443bb25a21a9. Dropping event network-vif-unplugged {{(pid=118444) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 13 21:21:04.816668 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-e07a4ea3-0134-47d9-9906-2cb5d5579b09 req-82889892-677f-417b-a79e-c4b5e02a4ef2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025098 Jul 13 21:21:04.817234 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 634/1290] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 13 21:21:05.124961 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-551e8351-dd99-4959-ba47-492016f2a4a3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:21:05.125563 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-551e8351-dd99-4959-ba47-492016f2a4a3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:21:05.132123 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-551e8351-dd99-4959-ba47-492016f2a4a3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:05.132566 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-551e8351-dd99-4959-ba47-492016f2a4a3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:05.133322 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-551e8351-dd99-4959-ba47-492016f2a4a3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:05.133749 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-551e8351-dd99-4959-ba47-492016f2a4a3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:05.300556 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-551e8351-dd99-4959-ba47-492016f2a4a3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:21:05.307964 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-551e8351-dd99-4959-ba47-492016f2a4a3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1517 microversion: 2.1 time: 0.186734 Jul 13 21:21:05.308517 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 657/1291] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:21:05 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1517 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:21:06.324987 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-50397d10-6faa-4c42-9e84-97a9811f6d3c tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:21:06.325660 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-50397d10-6faa-4c42-9e84-97a9811f6d3c tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:21:06.332341 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-50397d10-6faa-4c42-9e84-97a9811f6d3c tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:06.332788 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-50397d10-6faa-4c42-9e84-97a9811f6d3c tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:06.333532 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-50397d10-6faa-4c42-9e84-97a9811f6d3c tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:06.333953 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-50397d10-6faa-4c42-9e84-97a9811f6d3c tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:06.468820 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-50397d10-6faa-4c42-9e84-97a9811f6d3c tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:21:06.476854 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-50397d10-6faa-4c42-9e84-97a9811f6d3c tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1517 microversion: 2.1 time: 0.155699 Jul 13 21:21:06.477430 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 635/1292] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:21:06 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:21:07.494389 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-b9dae318-bfaf-4674-86c0-c33b6c7825c3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:21:07.495014 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-b9dae318-bfaf-4674-86c0-c33b6c7825c3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:21:07.501467 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b9dae318-bfaf-4674-86c0-c33b6c7825c3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:07.501903 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b9dae318-bfaf-4674-86c0-c33b6c7825c3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:07.502681 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b9dae318-bfaf-4674-86c0-c33b6c7825c3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:07.503107 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b9dae318-bfaf-4674-86c0-c33b6c7825c3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:07.628894 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b9dae318-bfaf-4674-86c0-c33b6c7825c3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:21:07.637653 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-b9dae318-bfaf-4674-86c0-c33b6c7825c3 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1517 microversion: 2.1 time: 0.147544 Jul 13 21:21:07.638220 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 658/1293] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:21:07 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1517 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:21:08.654600 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ed83dc42-4f8f-4f96-b848-8af7e0170647 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:21:08.655292 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-ed83dc42-4f8f-4f96-b848-8af7e0170647 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:21:08.661676 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ed83dc42-4f8f-4f96-b848-8af7e0170647 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:08.662126 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ed83dc42-4f8f-4f96-b848-8af7e0170647 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:08.662900 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ed83dc42-4f8f-4f96-b848-8af7e0170647 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:08.663339 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ed83dc42-4f8f-4f96-b848-8af7e0170647 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:08.794348 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ed83dc42-4f8f-4f96-b848-8af7e0170647 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:21:08.801902 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ed83dc42-4f8f-4f96-b848-8af7e0170647 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1519 microversion: 2.1 time: 0.151103 Jul 13 21:21:08.802464 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 636/1294] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:21:08 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:21:09.819285 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-b6af6719-3ce5-47ef-a799-721987f57762 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:21:09.819975 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-b6af6719-3ce5-47ef-a799-721987f57762 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:21:09.826326 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b6af6719-3ce5-47ef-a799-721987f57762 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:09.826810 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b6af6719-3ce5-47ef-a799-721987f57762 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:09.827573 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b6af6719-3ce5-47ef-a799-721987f57762 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:09.828008 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b6af6719-3ce5-47ef-a799-721987f57762 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:09.959459 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b6af6719-3ce5-47ef-a799-721987f57762 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:21:09.967743 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-b6af6719-3ce5-47ef-a799-721987f57762 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1575 microversion: 2.1 time: 0.152362 Jul 13 21:21:09.968311 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 659/1295] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:21:09 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:21:10.984422 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-938f1b1d-a0b7-4140-a85e-5eb333d22984 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:21:10.985038 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-938f1b1d-a0b7-4140-a85e-5eb333d22984 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:21:10.992057 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-938f1b1d-a0b7-4140-a85e-5eb333d22984 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:10.992504 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-938f1b1d-a0b7-4140-a85e-5eb333d22984 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:10.993250 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-938f1b1d-a0b7-4140-a85e-5eb333d22984 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:10.993678 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-938f1b1d-a0b7-4140-a85e-5eb333d22984 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:11.123642 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-938f1b1d-a0b7-4140-a85e-5eb333d22984 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:21:11.130975 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-938f1b1d-a0b7-4140-a85e-5eb333d22984 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1575 microversion: 2.1 time: 0.150318 Jul 13 21:21:11.131536 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 637/1296] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:21:10 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:21:12.148098 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-5616314b-635e-4b66-bcc8-b590ca52125a tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:21:12.148697 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-5616314b-635e-4b66-bcc8-b590ca52125a tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:21:12.155153 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5616314b-635e-4b66-bcc8-b590ca52125a tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:12.155591 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5616314b-635e-4b66-bcc8-b590ca52125a tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:12.156338 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5616314b-635e-4b66-bcc8-b590ca52125a tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:12.156764 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-5616314b-635e-4b66-bcc8-b590ca52125a tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:12.285449 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-5616314b-635e-4b66-bcc8-b590ca52125a tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:21:12.293371 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-5616314b-635e-4b66-bcc8-b590ca52125a tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1575 microversion: 2.1 time: 0.149118 Jul 13 21:21:12.293942 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 660/1297] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:21:12 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:21:13.310916 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-70502c86-c809-49d3-ba61-7d4a511f1f30 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:21:13.311514 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-70502c86-c809-49d3-ba61-7d4a511f1f30 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:21:13.317945 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-70502c86-c809-49d3-ba61-7d4a511f1f30 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:13.318386 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-70502c86-c809-49d3-ba61-7d4a511f1f30 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:13.319164 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-70502c86-c809-49d3-ba61-7d4a511f1f30 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:13.320107 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-70502c86-c809-49d3-ba61-7d4a511f1f30 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:13.447161 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-70502c86-c809-49d3-ba61-7d4a511f1f30 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:21:13.454542 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-70502c86-c809-49d3-ba61-7d4a511f1f30 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1575 microversion: 2.1 time: 0.147627 Jul 13 21:21:13.455131 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 638/1298] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:21:13 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:21:14.471588 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-0f432042-e365-44de-8e0b-651ff3534a9d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:21:14.472194 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-0f432042-e365-44de-8e0b-651ff3534a9d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:21:14.479200 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0f432042-e365-44de-8e0b-651ff3534a9d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:14.479640 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0f432042-e365-44de-8e0b-651ff3534a9d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:14.480398 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0f432042-e365-44de-8e0b-651ff3534a9d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:14.480822 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-0f432042-e365-44de-8e0b-651ff3534a9d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:14.607479 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-0f432042-e365-44de-8e0b-651ff3534a9d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:21:14.614903 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-0f432042-e365-44de-8e0b-651ff3534a9d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1575 microversion: 2.1 time: 0.147235 Jul 13 21:21:14.615464 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 661/1299] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:21:14 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:21:15.634580 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-99794e0c-af3e-41fb-83f2-9a206d63e324 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:21:15.635195 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-99794e0c-af3e-41fb-83f2-9a206d63e324 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:21:15.637562 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_api:SELECT=30 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:21:15.642861 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-99794e0c-af3e-41fb-83f2-9a206d63e324 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:15.643305 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-99794e0c-af3e-41fb-83f2-9a206d63e324 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:15.644052 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-99794e0c-af3e-41fb-83f2-9a206d63e324 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:15.644481 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-99794e0c-af3e-41fb-83f2-9a206d63e324 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:15.648476 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:21:15.775194 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-99794e0c-af3e-41fb-83f2-9a206d63e324 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:21:15.782451 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-99794e0c-af3e-41fb-83f2-9a206d63e324 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1575 microversion: 2.1 time: 0.154520 Jul 13 21:21:15.783042 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 639/1300] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:21:15 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:21:16.800033 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-47e20db4-d1f2-421d-ba91-1d95cc7166b5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:21:16.800630 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-47e20db4-d1f2-421d-ba91-1d95cc7166b5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:21:16.802637 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_api:SELECT=28 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:21:16.808618 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-47e20db4-d1f2-421d-ba91-1d95cc7166b5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:16.809062 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-47e20db4-d1f2-421d-ba91-1d95cc7166b5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:16.809830 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-47e20db4-d1f2-421d-ba91-1d95cc7166b5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:16.810286 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-47e20db4-d1f2-421d-ba91-1d95cc7166b5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:16.813071 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=84 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:21:16.940720 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-47e20db4-d1f2-421d-ba91-1d95cc7166b5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:21:16.948058 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-47e20db4-d1f2-421d-ba91-1d95cc7166b5 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1575 microversion: 2.1 time: 0.151867 Jul 13 21:21:16.948620 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 662/1301] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:21:16 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:21:17.965310 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-31fbe834-f641-46eb-847e-cab23b54377e tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:21:17.965898 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-31fbe834-f641-46eb-847e-cab23b54377e tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:21:17.971930 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-31fbe834-f641-46eb-847e-cab23b54377e tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:17.972373 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-31fbe834-f641-46eb-847e-cab23b54377e tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:17.973123 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-31fbe834-f641-46eb-847e-cab23b54377e tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:17.973549 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-31fbe834-f641-46eb-847e-cab23b54377e tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:18.103601 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-31fbe834-f641-46eb-847e-cab23b54377e tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:21:18.111479 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-31fbe834-f641-46eb-847e-cab23b54377e tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1575 microversion: 2.1 time: 0.150297 Jul 13 21:21:18.112044 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 640/1302] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:21:17 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:21:19.128010 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c75271ad-5d9c-4aeb-9a33-d7ce50e2c47d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:21:19.128613 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-c75271ad-5d9c-4aeb-9a33-d7ce50e2c47d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:21:19.135958 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c75271ad-5d9c-4aeb-9a33-d7ce50e2c47d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:19.136404 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c75271ad-5d9c-4aeb-9a33-d7ce50e2c47d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:19.137153 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c75271ad-5d9c-4aeb-9a33-d7ce50e2c47d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:19.137582 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c75271ad-5d9c-4aeb-9a33-d7ce50e2c47d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:19.268745 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c75271ad-5d9c-4aeb-9a33-d7ce50e2c47d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:21:19.276870 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-c75271ad-5d9c-4aeb-9a33-d7ce50e2c47d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1575 microversion: 2.1 time: 0.152718 Jul 13 21:21:19.277832 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 663/1303] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:21:19 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:21:20.293727 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-aa968293-da26-4310-b872-fc38e947bf64 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:21:20.294368 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-aa968293-da26-4310-b872-fc38e947bf64 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:21:20.300957 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-aa968293-da26-4310-b872-fc38e947bf64 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:20.301409 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-aa968293-da26-4310-b872-fc38e947bf64 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:20.302173 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-aa968293-da26-4310-b872-fc38e947bf64 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:20.302633 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-aa968293-da26-4310-b872-fc38e947bf64 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:20.429020 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-aa968293-da26-4310-b872-fc38e947bf64 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:21:20.436417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-aa968293-da26-4310-b872-fc38e947bf64 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1575 microversion: 2.1 time: 0.146532 Jul 13 21:21:20.436984 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 641/1304] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:21:20 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:21:20.824477 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-a5916936-19cd-4788-861e-a066e5f2fa5c req-d8cc9c59-369d-4e74-9346-f4292179867f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "780360c5-d271-4882-898a-443bb25a21a9", "name": "network-vif-plugged", "status": "completed", "tag": "ba158579-8748-42a9-bc6c-738c1c9a78ab"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:21:20.833116 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-a5916936-19cd-4788-861e-a066e5f2fa5c req-d8cc9c59-369d-4e74-9346-f4292179867f service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:20.833555 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-a5916936-19cd-4788-861e-a066e5f2fa5c req-d8cc9c59-369d-4e74-9346-f4292179867f service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:20.845112 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-a5916936-19cd-4788-861e-a066e5f2fa5c req-d8cc9c59-369d-4e74-9346-f4292179867f service nova] Creating event network-vif-plugged:ba158579-8748-42a9-bc6c-738c1c9a78ab for instance 780360c5-d271-4882-898a-443bb25a21a9 on hv-cinder-79987 Jul 13 21:21:20.850042 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-a5916936-19cd-4788-861e-a066e5f2fa5c req-d8cc9c59-369d-4e74-9346-f4292179867f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029189 Jul 13 21:21:20.850637 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 664/1305] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:21:21.453432 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-1bc7ff9e-d4e1-4454-8cfb-030028dd9cbe tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:21:21.454114 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-1bc7ff9e-d4e1-4454-8cfb-030028dd9cbe tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:21:21.460677 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1bc7ff9e-d4e1-4454-8cfb-030028dd9cbe tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:21.461126 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1bc7ff9e-d4e1-4454-8cfb-030028dd9cbe tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:21.461881 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1bc7ff9e-d4e1-4454-8cfb-030028dd9cbe tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:21.462321 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-1bc7ff9e-d4e1-4454-8cfb-030028dd9cbe tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:21.587677 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-1bc7ff9e-d4e1-4454-8cfb-030028dd9cbe tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:21:21.595066 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-1bc7ff9e-d4e1-4454-8cfb-030028dd9cbe tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1575 microversion: 2.1 time: 0.145522 Jul 13 21:21:21.595647 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 642/1306] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:21:21 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1575 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:21:22.613525 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-08872002-695a-476d-9906-c3d594cf4b52 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:21:22.614247 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-08872002-695a-476d-9906-c3d594cf4b52 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:21:22.620958 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-08872002-695a-476d-9906-c3d594cf4b52 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:22.621383 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-08872002-695a-476d-9906-c3d594cf4b52 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:22.622134 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-08872002-695a-476d-9906-c3d594cf4b52 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:22.622564 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-08872002-695a-476d-9906-c3d594cf4b52 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:22.752571 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-08872002-695a-476d-9906-c3d594cf4b52 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:21:22.761051 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-08872002-695a-476d-9906-c3d594cf4b52 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1575 microversion: 2.1 time: 0.152091 Jul 13 21:21:22.761614 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 665/1307] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:21:22 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:21:23.523665 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 13 21:21:23.523913 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Wed Jul 13 21:21:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 13 21:21:23.778187 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-3d0c0b01-2454-426b-a9a7-67be0870e29d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:21:23.778814 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-3d0c0b01-2454-426b-a9a7-67be0870e29d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:21:23.785213 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3d0c0b01-2454-426b-a9a7-67be0870e29d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:23.785654 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3d0c0b01-2454-426b-a9a7-67be0870e29d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:23.786403 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3d0c0b01-2454-426b-a9a7-67be0870e29d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:21:23.786866 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-3d0c0b01-2454-426b-a9a7-67be0870e29d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:21:23.915620 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-3d0c0b01-2454-426b-a9a7-67be0870e29d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:21:23.922929 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-3d0c0b01-2454-426b-a9a7-67be0870e29d tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1562 microversion: 2.1 time: 0.148502 Jul 13 21:21:23.923489 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 643/1308] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:21:23 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:22:35.446909 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_api:SELECT=7 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:22:35.448360 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell1:SELECT=19 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:22:35.452209 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-8a171d2d-acad-4042-9b7a-a740a4e5bf14 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-652922552", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1311636940", "security_groups": [{"name": "tempest-secgroup-smoke-30976695"}], "block_device_mapping_v2": [{"uuid": "db7dda30-adef-45a0-bed2-4a1319dc6b89", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5028f2a2-a7e7-4b29-9df9-5d7a5fdea67a"}]}} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:22:35.565390 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.network.neutron [None req-8a171d2d-acad-4042-9b7a-a740a4e5bf14 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] validate_networks() for [('5028f2a2-a7e7-4b29-9df9-5d7a5fdea67a', None, None, None, None, None)] {{(pid=118445) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 21:22:35.970471 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-8a171d2d-acad-4042-9b7a-a740a4e5bf14 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Flavor limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 21:22:35.970963 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-8a171d2d-acad-4042-9b7a-a740a4e5bf14 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Image limits 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 21:22:35.971430 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-8a171d2d-acad-4042-9b7a-a740a4e5bf14 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Flavor pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 21:22:35.971837 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-8a171d2d-acad-4042-9b7a-a740a4e5bf14 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Image pref 0:0:0 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 21:22:35.972242 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.virt.hardware [None req-8a171d2d-acad-4042-9b7a-a740a4e5bf14 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 21:22:35.981835 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8a171d2d-acad-4042-9b7a-a740a4e5bf14 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:35.982277 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8a171d2d-acad-4042-9b7a-a740a4e5bf14 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:35.983130 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8a171d2d-acad-4042-9b7a-a740a4e5bf14 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:35.983560 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-8a171d2d-acad-4042-9b7a-a740a4e5bf14 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:35.999796 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-8a171d2d-acad-4042-9b7a-a740a4e5bf14 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Getting quotas for project 3ed08895dc72486783da247550696d4c. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 21:22:36.003685 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.quota [None req-8a171d2d-acad-4042-9b7a-a740a4e5bf14 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Getting quotas for user 72ad69b2fab34a6180d7353c1aa730d3 and project 3ed08895dc72486783da247550696d4c. Resources: {'cores', 'instances', 'ram'} {{(pid=118445) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 21:22:36.059393 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8a171d2d-acad-4042-9b7a-a740a4e5bf14 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Going to run 1 instances... {{(pid=118445) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 21:22:36.061428 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-8a171d2d-acad-4042-9b7a-a740a4e5bf14 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: f2faa07f-eddb-42aa-8018-490625a3ede0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='db7dda30-adef-45a0-bed2-4a1319dc6b89',volume_size=None,volume_type=None)] {{(pid=118445) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 21:22:36.183811 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-8a171d2d-acad-4042-9b7a-a740a4e5bf14 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.738413 Jul 13 21:22:36.184448 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 666/1309] 10.222.0.39 () {60 vars in 1146 bytes} [Wed Jul 13 21:22:35 2022] POST /compute/v2.1/servers => generated 404 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 21:22:36.192040 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_api:SELECT=9 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:22:36.192778 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell1:SELECT=29 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:22:36.197778 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-96c5319e-e21f-4587-bc80-45d6c461a1be tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:22:36.198377 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-96c5319e-e21f-4587-bc80-45d6c461a1be tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: f2faa07f-eddb-42aa-8018-490625a3ede0] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:22:36.252631 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-96c5319e-e21f-4587-bc80-45d6c461a1be tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:22:36.259473 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-96c5319e-e21f-4587-bc80-45d6c461a1be tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0" status: 200 len: 1094 microversion: 2.1 time: 0.069095 Jul 13 21:22:36.260570 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 644/1310] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:22:36 2022] GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:22:37.276620 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-6bd05453-4a68-429c-a259-849771e497ff tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:22:37.277761 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-6bd05453-4a68-429c-a259-849771e497ff tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: f2faa07f-eddb-42aa-8018-490625a3ede0] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:22:37.284609 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6bd05453-4a68-429c-a259-849771e497ff tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:37.285051 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6bd05453-4a68-429c-a259-849771e497ff tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:37.285814 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6bd05453-4a68-429c-a259-849771e497ff tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:37.286239 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6bd05453-4a68-429c-a259-849771e497ff tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:37.348959 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-6bd05453-4a68-429c-a259-849771e497ff tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:22:37.357511 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-6bd05453-4a68-429c-a259-849771e497ff tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0" status: 200 len: 1210 microversion: 2.1 time: 0.085324 Jul 13 21:22:37.358192 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 667/1311] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:22:37 2022] GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0 => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:22:38.374825 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-2b91757b-8c3d-43d0-adc4-a3d994000934 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:22:38.375435 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-2b91757b-8c3d-43d0-adc4-a3d994000934 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: f2faa07f-eddb-42aa-8018-490625a3ede0] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:22:38.381903 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2b91757b-8c3d-43d0-adc4-a3d994000934 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:38.382354 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2b91757b-8c3d-43d0-adc4-a3d994000934 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:38.383148 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2b91757b-8c3d-43d0-adc4-a3d994000934 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:38.383838 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-2b91757b-8c3d-43d0-adc4-a3d994000934 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:38.582273 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-2b91757b-8c3d-43d0-adc4-a3d994000934 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:22:38.589815 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-2b91757b-8c3d-43d0-adc4-a3d994000934 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0" status: 200 len: 1264 microversion: 2.1 time: 0.218876 Jul 13 21:22:38.590382 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 645/1312] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:22:38 2022] GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0 => generated 1264 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:22:38.928428 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-084d1068-b696-4d27-91c6-73cdb468cdd4 req-bd983d0d-1582-45c7-bac0-bad0ec04799a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2faa07f-eddb-42aa-8018-490625a3ede0", "tag": "3925bd70-6eba-441e-9357-6abeef30447e"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:22:38.936838 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-084d1068-b696-4d27-91c6-73cdb468cdd4 req-bd983d0d-1582-45c7-bac0-bad0ec04799a service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:38.937347 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-084d1068-b696-4d27-91c6-73cdb468cdd4 req-bd983d0d-1582-45c7-bac0-bad0ec04799a service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:38.949046 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-084d1068-b696-4d27-91c6-73cdb468cdd4 req-bd983d0d-1582-45c7-bac0-bad0ec04799a service nova] Creating event network-changed:3925bd70-6eba-441e-9357-6abeef30447e for instance f2faa07f-eddb-42aa-8018-490625a3ede0 on hv-cinder-79987 Jul 13 21:22:38.954520 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-084d1068-b696-4d27-91c6-73cdb468cdd4 req-bd983d0d-1582-45c7-bac0-bad0ec04799a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095561 Jul 13 21:22:38.955433 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 668/1313] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:22:39.607265 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-e886a499-f2bc-4caf-8232-a083b7fd7e83 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:22:39.607825 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-e886a499-f2bc-4caf-8232-a083b7fd7e83 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: f2faa07f-eddb-42aa-8018-490625a3ede0] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:22:39.614426 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e886a499-f2bc-4caf-8232-a083b7fd7e83 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:39.614916 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e886a499-f2bc-4caf-8232-a083b7fd7e83 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:39.615686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e886a499-f2bc-4caf-8232-a083b7fd7e83 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:39.616124 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e886a499-f2bc-4caf-8232-a083b7fd7e83 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:39.748239 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-e886a499-f2bc-4caf-8232-a083b7fd7e83 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:22:39.755686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-e886a499-f2bc-4caf-8232-a083b7fd7e83 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0" status: 200 len: 1264 microversion: 2.1 time: 0.152414 Jul 13 21:22:39.756253 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 646/1314] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:22:39 2022] GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:22:40.773997 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ed715f5d-c23f-4d84-8c14-7b03e4c220c1 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:22:40.774712 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ed715f5d-c23f-4d84-8c14-7b03e4c220c1 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: f2faa07f-eddb-42aa-8018-490625a3ede0] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:22:40.781456 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ed715f5d-c23f-4d84-8c14-7b03e4c220c1 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:40.781894 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ed715f5d-c23f-4d84-8c14-7b03e4c220c1 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:40.782661 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ed715f5d-c23f-4d84-8c14-7b03e4c220c1 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:40.783092 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ed715f5d-c23f-4d84-8c14-7b03e4c220c1 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:40.911153 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ed715f5d-c23f-4d84-8c14-7b03e4c220c1 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:22:40.918423 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ed715f5d-c23f-4d84-8c14-7b03e4c220c1 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0" status: 200 len: 1264 microversion: 2.1 time: 0.148962 Jul 13 21:22:40.919012 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 669/1315] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:22:40 2022] GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:22:41.935592 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ca76f4f8-76a5-426f-be6b-754b45925133 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:22:41.936193 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-ca76f4f8-76a5-426f-be6b-754b45925133 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: f2faa07f-eddb-42aa-8018-490625a3ede0] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:22:41.942643 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ca76f4f8-76a5-426f-be6b-754b45925133 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:41.943091 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ca76f4f8-76a5-426f-be6b-754b45925133 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:41.943839 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ca76f4f8-76a5-426f-be6b-754b45925133 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:41.944267 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ca76f4f8-76a5-426f-be6b-754b45925133 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:42.074358 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ca76f4f8-76a5-426f-be6b-754b45925133 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:22:42.081640 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ca76f4f8-76a5-426f-be6b-754b45925133 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0" status: 200 len: 1264 microversion: 2.1 time: 0.150589 Jul 13 21:22:42.082195 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 647/1316] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:22:41 2022] GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:22:43.098118 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-b1e920ba-11c1-4629-ac03-c9dc96342e5f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:22:43.098747 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-b1e920ba-11c1-4629-ac03-c9dc96342e5f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: f2faa07f-eddb-42aa-8018-490625a3ede0] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:22:43.105208 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b1e920ba-11c1-4629-ac03-c9dc96342e5f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:43.105651 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b1e920ba-11c1-4629-ac03-c9dc96342e5f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:43.106405 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b1e920ba-11c1-4629-ac03-c9dc96342e5f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:43.106873 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-b1e920ba-11c1-4629-ac03-c9dc96342e5f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:43.237495 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-b1e920ba-11c1-4629-ac03-c9dc96342e5f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:22:43.245395 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-b1e920ba-11c1-4629-ac03-c9dc96342e5f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0" status: 200 len: 1264 microversion: 2.1 time: 0.150585 Jul 13 21:22:43.245952 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 670/1317] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:22:43 2022] GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:22:44.262550 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-ab4fd573-71d0-4eab-bc45-7b06a904f9a5 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:22:44.263181 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-ab4fd573-71d0-4eab-bc45-7b06a904f9a5 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: f2faa07f-eddb-42aa-8018-490625a3ede0] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:22:44.269556 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ab4fd573-71d0-4eab-bc45-7b06a904f9a5 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:44.270003 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ab4fd573-71d0-4eab-bc45-7b06a904f9a5 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:44.270815 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ab4fd573-71d0-4eab-bc45-7b06a904f9a5 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:44.271249 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-ab4fd573-71d0-4eab-bc45-7b06a904f9a5 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:44.400991 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-ab4fd573-71d0-4eab-bc45-7b06a904f9a5 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:22:44.409567 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-ab4fd573-71d0-4eab-bc45-7b06a904f9a5 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0" status: 200 len: 1264 microversion: 2.1 time: 0.151348 Jul 13 21:22:44.410254 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 648/1318] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:22:44 2022] GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:22:45.427079 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-c9678154-ac0b-4975-8a51-b3f827526f93 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:22:45.427685 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-c9678154-ac0b-4975-8a51-b3f827526f93 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: f2faa07f-eddb-42aa-8018-490625a3ede0] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:22:45.434122 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c9678154-ac0b-4975-8a51-b3f827526f93 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:45.434569 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c9678154-ac0b-4975-8a51-b3f827526f93 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:45.435355 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c9678154-ac0b-4975-8a51-b3f827526f93 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:45.435788 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-c9678154-ac0b-4975-8a51-b3f827526f93 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:45.562210 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-c9678154-ac0b-4975-8a51-b3f827526f93 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:22:45.569528 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-c9678154-ac0b-4975-8a51-b3f827526f93 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0" status: 200 len: 1264 microversion: 2.1 time: 0.146274 Jul 13 21:22:45.570081 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 671/1319] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:22:45 2022] GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0 => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:22:46.586671 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-7b3deaff-70c8-4cb7-9ac9-255fd4784bd9 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:22:46.587307 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-7b3deaff-70c8-4cb7-9ac9-255fd4784bd9 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: f2faa07f-eddb-42aa-8018-490625a3ede0] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:22:46.589620 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG dbcounter [-] [118444] Writing DB stats nova_cell0:SELECT=2 {{(pid=118444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:22:46.595865 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7b3deaff-70c8-4cb7-9ac9-255fd4784bd9 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:46.596326 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7b3deaff-70c8-4cb7-9ac9-255fd4784bd9 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:46.597084 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7b3deaff-70c8-4cb7-9ac9-255fd4784bd9 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:46.597523 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-7b3deaff-70c8-4cb7-9ac9-255fd4784bd9 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:46.728024 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-7b3deaff-70c8-4cb7-9ac9-255fd4784bd9 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:22:46.735478 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-7b3deaff-70c8-4cb7-9ac9-255fd4784bd9 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0" status: 200 len: 1264 microversion: 2.1 time: 0.152692 Jul 13 21:22:46.736042 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 649/1320] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:22:46 2022] GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:22:47.752805 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-a61407f4-c7db-473f-850d-1d8ab7ddeb19 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:22:47.753435 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-a61407f4-c7db-473f-850d-1d8ab7ddeb19 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: f2faa07f-eddb-42aa-8018-490625a3ede0] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:22:47.755535 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=2 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:22:47.756317 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG dbcounter [-] [118445] Writing DB stats nova_cell0:SELECT=6 {{(pid=118445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:22:47.762675 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a61407f4-c7db-473f-850d-1d8ab7ddeb19 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:47.763116 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a61407f4-c7db-473f-850d-1d8ab7ddeb19 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:47.763861 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a61407f4-c7db-473f-850d-1d8ab7ddeb19 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:47.764291 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a61407f4-c7db-473f-850d-1d8ab7ddeb19 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:47.895416 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-a61407f4-c7db-473f-850d-1d8ab7ddeb19 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:22:47.902808 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-a61407f4-c7db-473f-850d-1d8ab7ddeb19 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0" status: 200 len: 1264 microversion: 2.1 time: 0.153783 Jul 13 21:22:47.903368 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 672/1321] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:22:47 2022] GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:22:48.919342 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-53bf0dca-b173-4dcc-9647-f81458ba71e6 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:22:48.920073 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-53bf0dca-b173-4dcc-9647-f81458ba71e6 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: f2faa07f-eddb-42aa-8018-490625a3ede0] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:22:48.926127 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-53bf0dca-b173-4dcc-9647-f81458ba71e6 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:48.926572 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-53bf0dca-b173-4dcc-9647-f81458ba71e6 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:48.927352 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-53bf0dca-b173-4dcc-9647-f81458ba71e6 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:48.927780 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-53bf0dca-b173-4dcc-9647-f81458ba71e6 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:49.053205 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-53bf0dca-b173-4dcc-9647-f81458ba71e6 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:22:49.061007 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-53bf0dca-b173-4dcc-9647-f81458ba71e6 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0" status: 200 len: 1264 microversion: 2.1 time: 0.145459 Jul 13 21:22:49.061565 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 650/1322] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:22:48 2022] GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0 => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:22:50.078366 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-08811d13-0c36-4c8c-a329-75bb95b7c257 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:22:50.078995 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-08811d13-0c36-4c8c-a329-75bb95b7c257 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: f2faa07f-eddb-42aa-8018-490625a3ede0] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:22:50.085356 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-08811d13-0c36-4c8c-a329-75bb95b7c257 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:50.085798 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-08811d13-0c36-4c8c-a329-75bb95b7c257 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:50.086552 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-08811d13-0c36-4c8c-a329-75bb95b7c257 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:50.087007 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-08811d13-0c36-4c8c-a329-75bb95b7c257 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:50.213742 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-08811d13-0c36-4c8c-a329-75bb95b7c257 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:22:50.221733 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-08811d13-0c36-4c8c-a329-75bb95b7c257 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0" status: 200 len: 1264 microversion: 2.1 time: 0.147845 Jul 13 21:22:50.222295 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 673/1323] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:22:50 2022] GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:22:51.238683 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-35b5c7fb-3767-4315-9a0f-97e11fba379f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:22:51.239555 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-35b5c7fb-3767-4315-9a0f-97e11fba379f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: f2faa07f-eddb-42aa-8018-490625a3ede0] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:22:51.252946 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-35b5c7fb-3767-4315-9a0f-97e11fba379f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:51.253237 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-35b5c7fb-3767-4315-9a0f-97e11fba379f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:51.254409 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-35b5c7fb-3767-4315-9a0f-97e11fba379f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:51.254797 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-35b5c7fb-3767-4315-9a0f-97e11fba379f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:51.303694 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-60f2dda3-c95c-4a96-b59d-e789c7bb6ab7 req-a6b5bd06-ddb5-49dd-89f3-f5615c2a2431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2faa07f-eddb-42aa-8018-490625a3ede0", "name": "network-vif-plugged", "status": "completed", "tag": "3925bd70-6eba-441e-9357-6abeef30447e"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:22:51.312103 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-60f2dda3-c95c-4a96-b59d-e789c7bb6ab7 req-a6b5bd06-ddb5-49dd-89f3-f5615c2a2431 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:51.312542 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-60f2dda3-c95c-4a96-b59d-e789c7bb6ab7 req-a6b5bd06-ddb5-49dd-89f3-f5615c2a2431 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:51.323484 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-60f2dda3-c95c-4a96-b59d-e789c7bb6ab7 req-a6b5bd06-ddb5-49dd-89f3-f5615c2a2431 service nova] Creating event network-vif-plugged:3925bd70-6eba-441e-9357-6abeef30447e for instance f2faa07f-eddb-42aa-8018-490625a3ede0 on hv-cinder-79987 Jul 13 21:22:51.329144 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-60f2dda3-c95c-4a96-b59d-e789c7bb6ab7 req-a6b5bd06-ddb5-49dd-89f3-f5615c2a2431 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088356 Jul 13 21:22:51.329739 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 674/1324] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:22:51.403463 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-35b5c7fb-3767-4315-9a0f-97e11fba379f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:22:51.410698 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-35b5c7fb-3767-4315-9a0f-97e11fba379f tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0" status: 200 len: 1264 microversion: 2.1 time: 0.176052 Jul 13 21:22:51.411255 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 651/1325] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:22:51 2022] GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:22:52.428489 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-07107838-5e0a-4ac8-aa05-f59b5f04f6a7 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:22:52.429189 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-07107838-5e0a-4ac8-aa05-f59b5f04f6a7 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: f2faa07f-eddb-42aa-8018-490625a3ede0] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:22:52.435400 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-07107838-5e0a-4ac8-aa05-f59b5f04f6a7 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:52.435851 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-07107838-5e0a-4ac8-aa05-f59b5f04f6a7 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:52.436614 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-07107838-5e0a-4ac8-aa05-f59b5f04f6a7 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:52.437046 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-07107838-5e0a-4ac8-aa05-f59b5f04f6a7 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:52.565956 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-07107838-5e0a-4ac8-aa05-f59b5f04f6a7 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:22:52.573379 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-07107838-5e0a-4ac8-aa05-f59b5f04f6a7 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0" status: 200 len: 1264 microversion: 2.1 time: 0.149540 Jul 13 21:22:52.573928 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 675/1326] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:22:52 2022] GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:22:53.591421 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-e8f67df8-acc5-4e13-9935-14f4641de470 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:22:53.592120 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-e8f67df8-acc5-4e13-9935-14f4641de470 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: f2faa07f-eddb-42aa-8018-490625a3ede0] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:22:53.598461 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e8f67df8-acc5-4e13-9935-14f4641de470 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:53.598932 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e8f67df8-acc5-4e13-9935-14f4641de470 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:53.599686 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e8f67df8-acc5-4e13-9935-14f4641de470 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:53.600119 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-e8f67df8-acc5-4e13-9935-14f4641de470 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:53.825344 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-e8f67df8-acc5-4e13-9935-14f4641de470 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:22:53.832429 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-96ea330c-8ec2-4fc6-8591-ff07f2cd16a6 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:22:53.832981 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-96ea330c-8ec2-4fc6-8591-ff07f2cd16a6 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:22:53.835603 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-e8f67df8-acc5-4e13-9935-14f4641de470 tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0" status: 200 len: 1450 microversion: 2.1 time: 0.248485 Jul 13 21:22:53.836525 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 652/1327] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:22:53 2022] GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0 => generated 1450 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:22:53.840897 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-96ea330c-8ec2-4fc6-8591-ff07f2cd16a6 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:53.841551 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-96ea330c-8ec2-4fc6-8591-ff07f2cd16a6 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:53.842503 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-96ea330c-8ec2-4fc6-8591-ff07f2cd16a6 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:53.843041 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-34594ee7-8456-413f-a05e-9b12e78249f1 req-094e3a6d-46a9-41a5-ac69-f26241decbf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "780360c5-d271-4882-898a-443bb25a21a9", "tag": "ba158579-8748-42a9-bc6c-738c1c9a78ab"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:22:53.843486 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-96ea330c-8ec2-4fc6-8591-ff07f2cd16a6 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:53.852263 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-34594ee7-8456-413f-a05e-9b12e78249f1 req-094e3a6d-46a9-41a5-ac69-f26241decbf2 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:53.852704 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-34594ee7-8456-413f-a05e-9b12e78249f1 req-094e3a6d-46a9-41a5-ac69-f26241decbf2 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:53.864577 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-34594ee7-8456-413f-a05e-9b12e78249f1 req-094e3a6d-46a9-41a5-ac69-f26241decbf2 service nova] Creating event network-changed:ba158579-8748-42a9-bc6c-738c1c9a78ab for instance 780360c5-d271-4882-898a-443bb25a21a9 on hv-cinder-79987 Jul 13 21:22:53.869736 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-34594ee7-8456-413f-a05e-9b12e78249f1 req-094e3a6d-46a9-41a5-ac69-f26241decbf2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031824 Jul 13 21:22:53.870416 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 653/1328] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:22:53.874302 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-96ea330c-8ec2-4fc6-8591-ff07f2cd16a6 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Going to try to terminate instance {{(pid=118445) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 21:22:53.875858 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-5dbdec53-d515-414b-bd83-c58f5409979e tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:22:53.876561 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-5dbdec53-d515-414b-bd83-c58f5409979e tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] [instance: f2faa07f-eddb-42aa-8018-490625a3ede0] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:22:53.882767 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5dbdec53-d515-414b-bd83-c58f5409979e tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:53.883483 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5dbdec53-d515-414b-bd83-c58f5409979e tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:53.884252 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5dbdec53-d515-414b-bd83-c58f5409979e tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:53.884697 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-5dbdec53-d515-414b-bd83-c58f5409979e tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:53.965603 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-96ea330c-8ec2-4fc6-8591-ff07f2cd16a6 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "DELETE /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 204 len: 0 microversion: 2.1 time: 0.136655 Jul 13 21:22:53.966752 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 676/1329] 10.222.0.39 () {58 vars in 1238 bytes} [Wed Jul 13 21:22:53 2022] DELETE /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 21:22:53.976096 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-ed597b23-791c-4141-9370-80f4f6573e90 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:22:53.977902 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-ed597b23-791c-4141-9370-80f4f6573e90 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:22:53.984226 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ed597b23-791c-4141-9370-80f4f6573e90 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:53.984971 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ed597b23-791c-4141-9370-80f4f6573e90 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:53.985955 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ed597b23-791c-4141-9370-80f4f6573e90 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:53.986591 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-ed597b23-791c-4141-9370-80f4f6573e90 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:54.056881 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-5dbdec53-d515-414b-bd83-c58f5409979e tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ad69b2fab34a6180d7353c1aa730d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed08895dc72486783da247550696d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:22:54.068018 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-5dbdec53-d515-414b-bd83-c58f5409979e tempest-TestVolumeBootPattern-1525868514 tempest-TestVolumeBootPattern-1525868514-project] 10.222.0.39 "GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0" status: 200 len: 1450 microversion: 2.1 time: 0.196191 Jul 13 21:22:54.068608 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 654/1330] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:22:53 2022] GET /compute/v2.1/servers/f2faa07f-eddb-42aa-8018-490625a3ede0 => generated 1450 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:22:54.149367 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-ed597b23-791c-4141-9370-80f4f6573e90 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:22:54.158877 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-ed597b23-791c-4141-9370-80f4f6573e90 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1568 microversion: 2.1 time: 0.187801 Jul 13 21:22:54.159449 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 677/1331] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:22:53 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 21:22:55.175617 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-c2d6b63b-e0c8-4981-9f07-a22f6a4ed39c tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:22:55.176202 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-c2d6b63b-e0c8-4981-9f07-a22f6a4ed39c tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:22:55.182416 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c2d6b63b-e0c8-4981-9f07-a22f6a4ed39c tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:55.182901 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c2d6b63b-e0c8-4981-9f07-a22f6a4ed39c tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:55.184201 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c2d6b63b-e0c8-4981-9f07-a22f6a4ed39c tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:55.184638 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-c2d6b63b-e0c8-4981-9f07-a22f6a4ed39c tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:55.415051 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-c2d6b63b-e0c8-4981-9f07-a22f6a4ed39c tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:22:55.422996 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-c2d6b63b-e0c8-4981-9f07-a22f6a4ed39c tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1568 microversion: 2.1 time: 0.251153 Jul 13 21:22:55.423569 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 655/1332] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:22:55 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1568 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:22:56.183333 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [req-9dc61e1e-8b26-4a32-9319-7d999e036db9 req-2921273d-1f8c-4f67-9068-78a6b8ac6afd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2faa07f-eddb-42aa-8018-490625a3ede0", "tag": "3925bd70-6eba-441e-9357-6abeef30447e"}]} {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:22:56.191620 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-9dc61e1e-8b26-4a32-9319-7d999e036db9 req-2921273d-1f8c-4f67-9068-78a6b8ac6afd service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:56.192064 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [req-9dc61e1e-8b26-4a32-9319-7d999e036db9 req-2921273d-1f8c-4f67-9068-78a6b8ac6afd service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:56.203163 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.compute.server_external_events [req-9dc61e1e-8b26-4a32-9319-7d999e036db9 req-2921273d-1f8c-4f67-9068-78a6b8ac6afd service nova] Creating event network-changed:3925bd70-6eba-441e-9357-6abeef30447e for instance f2faa07f-eddb-42aa-8018-490625a3ede0 on hv-cinder-79987 Jul 13 21:22:56.216454 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [req-9dc61e1e-8b26-4a32-9319-7d999e036db9 req-2921273d-1f8c-4f67-9068-78a6b8ac6afd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036615 Jul 13 21:22:56.217341 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 678/1333] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:22:56.440666 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-b11dbb97-c9fb-47c4-be8b-5158218c572a tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:22:56.442080 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.compute.api [None req-b11dbb97-c9fb-47c4-be8b-5158218c572a tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118444) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:22:56.449793 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b11dbb97-c9fb-47c4-be8b-5158218c572a tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:56.450785 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b11dbb97-c9fb-47c4-be8b-5158218c572a tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:56.452074 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b11dbb97-c9fb-47c4-be8b-5158218c572a tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:56.452826 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [None req-b11dbb97-c9fb-47c4-be8b-5158218c572a tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:56.736749 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.policy [None req-b11dbb97-c9fb-47c4-be8b-5158218c572a tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118444) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:22:56.745154 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-b11dbb97-c9fb-47c4-be8b-5158218c572a tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1568 microversion: 2.1 time: 0.308120 Jul 13 21:22:56.746565 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 656/1334] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:22:56 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1568 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:22:57.765296 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-a355dfb5-a943-447a-b5d9-7dba0c5affdb tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:22:57.766558 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-a355dfb5-a943-447a-b5d9-7dba0c5affdb tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:22:57.773187 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a355dfb5-a943-447a-b5d9-7dba0c5affdb tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:57.773622 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a355dfb5-a943-447a-b5d9-7dba0c5affdb tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:57.774404 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a355dfb5-a943-447a-b5d9-7dba0c5affdb tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:57.774878 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a355dfb5-a943-447a-b5d9-7dba0c5affdb tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:57.806883 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a355dfb5-a943-447a-b5d9-7dba0c5affdb tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:57.807331 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-a355dfb5-a943-447a-b5d9-7dba0c5affdb tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:57.808006 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.objects.instance [None req-a355dfb5-a943-447a-b5d9-7dba0c5affdb tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lazy-loading 'fault' on Instance uuid 780360c5-d271-4882-898a-443bb25a21a9 {{(pid=118445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 21:22:57.856084 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.policy [None req-a355dfb5-a943-447a-b5d9-7dba0c5affdb tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262475732e324ecbbf1bb54c33fcc425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed37e30e7b4a7188823efe184af5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118445) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 21:22:57.864625 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-a355dfb5-a943-447a-b5d9-7dba0c5affdb tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 200 len: 1177 microversion: 2.1 time: 0.104748 Jul 13 21:22:57.865197 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 679/1335] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:22:57 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 1177 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 21:22:58.231448 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [req-190beb91-5772-4b9b-a282-aa573fc18707 req-52782771-9a49-426c-a1e7-82f8e8c71b77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "780360c5-d271-4882-898a-443bb25a21a9", "name": "network-vif-deleted", "tag": "ba158579-8748-42a9-bc6c-738c1c9a78ab"}]} {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 21:22:58.239947 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-190beb91-5772-4b9b-a282-aa573fc18707 req-52782771-9a49-426c-a1e7-82f8e8c71b77 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:58.240384 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG oslo_concurrency.lockutils [req-190beb91-5772-4b9b-a282-aa573fc18707 req-52782771-9a49-426c-a1e7-82f8e8c71b77 service nova] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:58.251304 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.compute.server_external_events [req-190beb91-5772-4b9b-a282-aa573fc18707 req-52782771-9a49-426c-a1e7-82f8e8c71b77 service nova] Creating event network-vif-deleted:ba158579-8748-42a9-bc6c-738c1c9a78ab for instance 780360c5-d271-4882-898a-443bb25a21a9 on hv-cinder-79987 Jul 13 21:22:58.256081 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [req-190beb91-5772-4b9b-a282-aa573fc18707 req-52782771-9a49-426c-a1e7-82f8e8c71b77 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028800 Jul 13 21:22:58.256636 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 657/1336] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Jul 13 21:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 21:22:58.881267 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-6342a4b6-dced-4a42-ad12-684a331d5ef7 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '>' {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:22:58.881856 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.compute.api [None req-6342a4b6-dced-4a42-ad12-684a331d5ef7 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [instance: 780360c5-d271-4882-898a-443bb25a21a9] Fetching instance by UUID {{(pid=118445) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 21:22:58.888545 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6342a4b6-dced-4a42-ad12-684a331d5ef7 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:58.888982 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6342a4b6-dced-4a42-ad12-684a331d5ef7 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:58.889730 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6342a4b6-dced-4a42-ad12-684a331d5ef7 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 21:22:58.890153 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG oslo_concurrency.lockutils [None req-6342a4b6-dced-4a42-ad12-684a331d5ef7 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Lock "7dc43128-f6a8-43a1-9bd0-df8b45860749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 21:22:58.903413 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.wsgi [None req-6342a4b6-dced-4a42-ad12-684a331d5ef7 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] HTTP exception thrown: Instance 780360c5-d271-4882-898a-443bb25a21a9 could not be found. Jul 13 21:22:58.904997 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-6342a4b6-dced-4a42-ad12-684a331d5ef7 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Request method failure captured: Jul 13 21:22:58.904997 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: request: GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 HTTP/1.1 Jul 13 21:22:58.904997 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept: application/json Jul 13 21:22:58.904997 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Accept-Encoding: identity Jul 13 21:22:58.904997 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Connection: close Jul 13 21:22:58.904997 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Length: 0 Jul 13 21:22:58.904997 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Content-Type: application/json Jul 13 21:22:58.904997 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Host: 10.222.0.39 Jul 13 21:22:58.904997 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Openstack-System-Scope: None Jul 13 21:22:58.904997 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: User-Agent: python-urllib3/1.26.9 Jul 13 21:22:58.904997 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Auth-Token: gAAAAABizzZ3Cm8wzqfk9eraOJcL02qlEyuCPfFtVjaL0wFdMikKm66808kIZxTBPXJ3i5HmAypRMrjPBHnXwJp4dWB4nw4aWuiCcregaAufonbxYxzb8DOKvJBvBidAvF2WFs28NjJBJUFs0-7H0wfI1MMsBl03EyftuInfSMk-vsmQfZ01gYM Jul 13 21:22:58.904997 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Id: None Jul 13 21:22:58.904997 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Domain-Name: None Jul 13 21:22:58.904997 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Identity-Status: Confirmed Jul 13 21:22:58.904997 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Is-Admin-Project: True Jul 13 21:22:58.904997 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Id: default Jul 13 21:22:58.904997 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Domain-Name: Default Jul 13 21:22:58.904997 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Id: 59ed37e30e7b4a7188823efe184af5a1 Jul 13 21:22:58.904997 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Project-Name: tempest-TestShelveInstance-1531245431 Jul 13 21:22:58.904997 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Role: member,reader Jul 13 21:22:58.904997 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Roles: member,reader Jul 13 21:22:58.906777 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/59ed37e30e7b4a7188823efe184af5a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/59ed37e30e7b4a7188823efe184af5a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_59ed37e30e7b4a7188823efe184af5a1", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/59ed37e30e7b4a7188823efe184af5a1"}]}] Jul 13 21:22:58.906777 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant: tempest-TestShelveInstance-1531245431 Jul 13 21:22:58.906777 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Id: 59ed37e30e7b4a7188823efe184af5a1 Jul 13 21:22:58.906777 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-Tenant-Name: tempest-TestShelveInstance-1531245431 Jul 13 21:22:58.906777 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User: tempest-TestShelveInstance-1531245431-project Jul 13 21:22:58.906777 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Id: default Jul 13 21:22:58.906777 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Domain-Name: Default Jul 13 21:22:58.906777 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Id: 262475732e324ecbbf1bb54c33fcc425 Jul 13 21:22:58.906777 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: X-User-Name: tempest-TestShelveInstance-1531245431-project Jul 13 21:22:58.906777 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: method: > Jul 13 21:22:58.906777 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: exception: Instance 780360c5-d271-4882-898a-443bb25a21a9 could not be found. Jul 13 21:22:58.906777 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: action_args: {'id': '780360c5-d271-4882-898a-443bb25a21a9'} Jul 13 21:22:58.907849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: {{(pid=118445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 21:22:58.907849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:22:58.907849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 21:22:58.907849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 21:22:58.907849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 21:22:58.907849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 21:22:58.907849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 21:22:58.907849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 21:22:58.907849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 21:22:58.907849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 21:22:58.907849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 780360c5-d271-4882-898a-443bb25a21a9 could not be found. Jul 13 21:22:58.907849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:22:58.907849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:22:58.907849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:22:58.907849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:22:58.907849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:22:58.907849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:22:58.907849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 21:22:58.907849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 21:22:58.907849 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 21:22:58.909511 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 21:22:58.909511 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 21:22:58.909511 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 21:22:58.909511 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 21:22:58.909511 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 21:22:58.909511 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 21:22:58.909511 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 21:22:58.909511 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 780360c5-d271-4882-898a-443bb25a21a9 could not be found. Jul 13 21:22:58.909511 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:22:58.909511 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 21:22:58.909511 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:22:58.909511 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 21:22:58.909511 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 21:22:58.909511 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 21:22:58.909511 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 21:22:58.909511 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 21:22:58.909511 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 780360c5-d271-4882-898a-443bb25a21a9 could not be found. Jul 13 21:22:58.909511 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: ERROR nova.api.openstack.wsgi Jul 13 21:22:58.911079 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: DEBUG nova.api.openstack.wsgi [None req-6342a4b6-dced-4a42-ad12-684a331d5ef7 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Returning 404 to user: Instance 780360c5-d271-4882-898a-443bb25a21a9 could not be found. {{(pid=118445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 21:22:58.911079 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO nova.api.openstack.requestlog [None req-6342a4b6-dced-4a42-ad12-684a331d5ef7 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9" status: 404 len: 111 microversion: 2.1 time: 0.029033 Jul 13 21:22:58.911079 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: [pid: 118445|app: 0|req: 680/1337] 10.222.0.39 () {58 vars in 1235 bytes} [Wed Jul 13 21:22:58 2022] GET /compute/v2.1/servers/780360c5-d271-4882-898a-443bb25a21a9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 21:22:59.063940 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: DEBUG nova.api.openstack.wsgi [None req-02c8261f-8b4c-410a-8bb2-c35f8fa10b84 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] Calling method '.version_select at 0x7f96e8562d30>' {{(pid=118444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 21:22:59.067443 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: ERROR oslo.messaging._drivers.impl_rabbit [None req-02c8261f-8b4c-410a-8bb2-c35f8fa10b84 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [66125711-6262-4271-b047-84abb5a6707c] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 13 21:23:00.075746 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO oslo.messaging._drivers.impl_rabbit [None req-02c8261f-8b4c-410a-8bb2-c35f8fa10b84 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] [66125711-6262-4271-b047-84abb5a6707c] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 55818. Jul 13 21:23:00.093486 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO nova.api.openstack.requestlog [None req-02c8261f-8b4c-410a-8bb2-c35f8fa10b84 tempest-TestShelveInstance-1531245431 tempest-TestShelveInstance-1531245431-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1919820440" status: 202 len: 0 microversion: 2.1 time: 1.033674 Jul 13 21:23:00.094055 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: [pid: 118444|app: 0|req: 658/1338] 10.222.0.39 () {58 vars in 1253 bytes} [Wed Jul 13 21:22:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1919820440 => generated 0 bytes in 1035 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 21:24:43.531944 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 13 21:24:43.532425 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Wed Jul 13 21:24:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 13 21:25:17.951417 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 13 21:25:17.951938 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Wed Jul 13 21:25:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 13 21:25:18.987576 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 13 21:25:18.988121 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Wed Jul 13 21:25:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 13 21:26:29.192434 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 13 21:26:29.193290 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Wed Jul 13 21:26:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 13 21:28:00.357325 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 13 21:28:00.357957 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Wed Jul 13 21:28:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 13 21:28:03.540057 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 13 21:28:03.540546 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Wed Jul 13 21:28:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 13 21:28:09.092695 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 13 21:28:09.093247 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Wed Jul 13 21:28:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 13 21:28:37.959796 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 13 21:28:37.960299 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Wed Jul 13 21:28:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 13 21:28:38.996559 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 13 21:28:38.997106 dv-cinder-799871-27-iscsi devstack@n-api.service[118445]: Wed Jul 13 21:28:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 13 21:29:49.201776 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 13 21:29:49.202432 dv-cinder-799871-27-iscsi devstack@n-api.service[118444]: Wed Jul 13 21:29:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!